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1.  Scientific  Progress  and  Accomplishments 

1.1  Objectives 

The  objective  of  the  project  was  to  advance  the  state-of-the-art  in  adaptive  methods  for  disturbance 
cancellation.  Two  closely-related  applications  were  considered:  active  noise  control  and  active 
vibration  control.  Improvements  in  adaptive  methods  for  these  applications  are  of  potential  benefit 
to  several  systems  used  by  the  Army,  and  helicopters  in  particular. 

A  single-channel  active  noise  control  system  is  shown  on  Fig.  1.  A  microphone  senses  the  noise 
at  a  location  to  be  made  quiet,  and  a  digital  signal  processor  (DSP)  uses  the  signal  to  produce  a 
sound  wave  that  will  reduce  the  noise.  The  DSP  implements  a  control  algorithm  that  is  typically 
adaptive,  and  must  be  computed  at  a  high  sampling  rate.  The  focus  of  the  project  was  this 
algorithm,  or  software,  that  is  coded  on  the  DSP.  Performance  and  computational  requirements 
were  driving  forces  of  the  investigation. 

The  first  track  of  the  project  was  aimed  at  studying  design  and  implementation  issues  for  adap¬ 
tive  methods  as  applied  to  multi-channel  systems.  As  opposed  to  Fig.  1,  practical  active  noise 

*Dr.  Scott  Douglas  contributed  some  portions  of  this  report  and  is  now  with  the  Department  of  Electrical 
Engineering,  Southern  Methodist  University,  Dallas,  TX  75275.  Tel.:  (214)  768  4595.  E-mail:  douglas@seas.smu.edu. 
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Figure  1:  Single-channel  active  noise  control  system 

control  systems  are  typically  multi-channel  systems,  that  is,  rely  on  several  speakers  and  micro¬ 
phones  to  perform  the  noise  cancellation.  Indeed,  the  attenuation  of  noise  over  a  significant  area  of 
space  usually  requires  the  use  of  multiple  sound  sources.  For  vibration  control,  multiple  actuators 
are  necessary  when  several  degrees  of  freedom  are  involved.  In  the  project,  novel  implementations 
of  commonly-used  adaptive  control  structures  were  investigated  that  required  significantly  fewer 
computations  than  existing  structures.  Delay  compensation  techniques  were  also  developed  that 
enhanced  the  performance  of  certain  algorithms  in  the  presence  of  large  delays,  without  incurring 
the  usual  penalties  in  terms  of  computations  and  memory  accesses. 

The  second  track  of  the  project  investigated  new  algorithms  tailored  to  the  rejection  of  periodic 
disturbances.  Such  disturbances  are  common  because  of  numei'ous  applications  where  rotating 
machines  are  the  source  of  unwanted  vibration  and  noise.  Two  approaches  were  studied:  an  indirect 
approach  which  combined  frequency  estimation  with  adaptive  disturbance  rejection,  and  a  direct 
approach  which  integrated  frequency  estimation  and  disturbance  cancellation.  Both  approaches 
were  developed  for  situations  where  the  frequency  of  the  disturbance  varied  significantly  with  time 
and  they  eliminated  the  often-found  requirement  of  a  sensor  placed  on  or  close  to  the  source  of 
the  disturbance.  The  algorithms  were  evaluated  in  experiments  on  an  active  noise  control  testbed 
developed  under  the  grant  at  the  University  of  Utah. 

1.2  Accomplishments  in  Multi-channel  Systems 

The  filtered-X  LMS  algorithm,  commonly  used  in  feedforward  multi-channel  active  noise  control 
systems,  is  difficult  to  implement  for  systems  with  more  than  a  few  input  sensors,  output  actuators, 
and  error  sensors,  due  to  the  large  number  of  computations  required.  Since  large-area  quieting  de¬ 
mands  a  large  number  of  controller  channels,  this  difficulty  limits  the  usefulness  of  the  algorithm. 
A  careful  study  of  the  computations  required  by  the  standard  implementation  of  the  algorithm 
indicated  that  the  bulk  of  the  complexity  lied  in  the  controller  coefficient  updates.  With  this  obser¬ 
vation  in  mind,  a  computationally-efficient,  fast  convolution  algorithm  was  developed.  The  method 
computes  quantities  that  are  needed  by  the  filtered-X  LMS  controller  and  calculates  correction 
terms  at  each  time  instant  to  produce  the  exact  controller  output  signals.  The  complexity  of  the 
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new  scheme  was  much  reduced  over  that  of  the  standard  implementation:  reductions  of  90%  or 
more  in  the  overall  computational  and  memory  usage  were  found  to  be  common  [l],  [8]. 

The  results  obtained  with  the  filtered-X  LMS  algorithm  encouraged  the  application  of  the  tech¬ 
nique  to  other  algorithms.  Computationally-efficient,  block  convolution  methods  were  developed 
for  several  algorithms  popular  in  single-channel  feedforward  active  noise  control.  The  methods 
employed  a  two-step  calculation  process  and  yielded  behavior  that  was  identical  to  the  original 
algorithm  implementation,  but  with  a  reduced  computational  complexity.  In  general,  reductions  in 
the  number  of  multiplications  of  the  order  of  25%  were  found  to  be  common  [4] ,  [7] 

In  the  area  of  stability  and  parameter  convergence,  an  efficient  delay  compensation  technique 
was  developed  for  the  filtered  X-LMS  algorithm  that  effectively  removed  the  coefficient  delays  in 
the  error  signals  that  were  caused  by  the  plant  [3].  The  resulting  algorithm  behaved  like  the 
LMS  algorithm,  and  since  the  behavior  of  the  LMS  algorithm  was  well-understood,  the  behavior 
of  this  delay-compensated  system  could  be  easily  predicted  from  existing  results  in  adaptive  filter 
theory.  This  feature  eased  the  selection  of  adaptation  parameters  for  the  stability  of  the  system. 
The  delay  compensation  technique  was  expanded  into  a  family  of  delay  compensation  methods  for 
gradient-based  algorithms  with  feedback  delay  .  These  techniques  could  be  used  to  mitigate  the 
algorithm  instabilities  caused  by  plants  that  exhibit  a  large  amount  of  delay  and  whose  characteris¬ 
tics  vary  with  time.  In  particular,  the  numerically-robust  techniques  were  extended  to  useful  signal 
processing  algorithms  such  as  the  sliding  discrete  Fourier  and  cosine  transforms  [2],  [5].  Further  a 
significant  breakthrough  was  obtained  when  the  methods  were  extended  to  the  case  of  time-varying 
plants  [6]. 

The  methods  can  be  combined  in  several  ways  to  obtain  algorithms  that  do  not  compute  the 
plant-filtered  input  signal,  thus  avoiding  the  memory  allocation  and  accesses  that  can  make  algo¬ 
rithms  difficult  to  implement  on  typical  digital  signal  processor  platforms.  Reducing  the  number  of 
memory  accesses  is  important  for  some  adaptive  signal  processing  problems,  notably  acoustic  echo 
cancellation.  Using  the  delay-compensation  method,  four  novel  implementations  of  the  normalized 
least-mean  square  (NLMS)  algorithm  with  decorrelation  filters  were  developed  for  acoustic  echo 
cancellation  [9].  For  short  decorrelation  filter  lengths,  the  complexity  of  the  new  implementations 
is  nearly  the  same  as  the  complexity  of  the  uncompensated  NLMS  adaptive  filter,  as  opposed  to  the 
conventional  implementation  of  the  compensation,  which  increases  the  complexity  by  about  50%. 
Two  of  the  novel  implementations  also  saved  on  memory  use  over  the  conventional  implementation. 

1.3  Accomplishments  in  Periodic  Disturbance  Rejection 

Two  approaches  were  proposed  for  the  rejection  of  periodic  disturbances  with  unknown  frequency 
[11].  The  first  was  an  indirect  algorithm  where  the  frequency  of  the  disturbance  was  estimated, 
and  the  estimate  was  used  in  an  adaptive  algorithm  that  adjusted  the  magnitude  and  phase  of  the 
input  needed  to  cancel  the  effect  of  the  disturbance.  A  direct  algorithm  was  also  investigated  in 
which  the  frequency  estimation  and  the  disturbance  cancellation  were  performed  simultaneously. 
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Analyses  were  presented  for  both  schemes  and  the  results  were  found  useful  for  the  selection  of  the 
design  parameters.  Simulations  were  given  that  demonstrated  the  validity  of  the  analytical  results 
and  the  ability  of  the  algorithms  to  reject  sinusoidal  disturbances  of  unknown  frequency. 


Figure  2:  Direct  approach  for  sinusoidal  disturbance  cancellation 

The  concept  of  the  direct  approach  is  shown  in  Fig.  2.  The  control  system  is  similar,  but  distinct, 
from  the  well-known  and  highly  successful  phase-locked  loops  used  in  communication  systems.  A 
key  tool  in  the  analysis  of  the  algorithm  was  a  nonlinear  time-invariant  approximation  of  the 
control  system  that  could  be  used  for  analysis  and  design.  Simulations  showed  that  the  nonlinear 
approximation  reflected  very  well  the  transient  behavior  of  the  scheme.  Further,  this  approximation 
was  useful  to  predict  the  ability  of  the  algorithm  to  reject  slowly-varying  disturbances,  which  was 
validated  in  simulations  [10].  In  [16],  the  algorithm  was  analyzed  in  the  presence  of  measurement 
noise,  and  estimates  were  obtained  for  the  variance  of  the  output  and  of  the  adaptive  parameters. 
In  both  [10]  and  [16],  simulations  verified  the  validity  of  the  analytical  results,  and  demonstrated 
the  excellent  properties  of  the  algorithm  under  non-ideal  conditions. 

A  real-time  implementation  of  the  direct  scheme  in  an  active  noise  control  task  was  successfully 
performed  on  a  DSP  system  in  the  principal  investigators’  laboratory.  The  active  noise  control 
testbed  had  been  developed  under  the  grant  with  the  help  of  undergraduate  students  associated  with 
the  project.  The  scheme  provided  a  25dB  reduction  of  a  sinusoidal  tone  of  unknown  frequency.  The 
direct  method  was  also  extended  to  handle  the  case  of  multiple  harmonics.  The  resulting  algorithm 
is  shown  in  Fig.  3  for  the  case  of  a  fundamental  and  a  third  harmonic.  An  interesting  feature  of 
the  algorithm  was  that  the  frequencies  of  the  different  components  of  the  control  signal  were  tied 
together,  based  on  the  knowledge  of  the  relationship  between  the  frequencies  of  the  components  of 
the  disturbance.  On  the  figure,  this  relationship  is  represented  by  the  multiplying  factor  of  ”3”. 
Laboratory  experiments  demonstrated  the  success  of  the  algorithm  in  a  practical  environment, 
and  the  results  appeared  in  a  conference  paper  that  has  now  been  accepted  for  publication  in  a 
journal  [14].  The  scheme  implemented  an  automatic  tuning  procedure  that  adjusted  the  controller 
parameters  based  on  the  identified  frequency  response  of  the  plant,  and  the  controller  gains  were 
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scheduled  as  functions  of  the  estimated  frequency  of  the  disturbance. 


Figure  3:  Direct  algorithm  for  periodic  disturbance  cancellation 

In  [12],  the  direct  algorithm  was  compared  to  an  adaptive  algorithm  based  on  the  internal  model 
principle.  This  study  was  pursued  in  response  to  comments  made  by  a  reviewer  of  the  original 
proposal  for  the  grant.  It  was  found  that  the  algorithm  based  on  the  internal  model  principle  had 
interesting  advantages  by  guaranteeing  global  stability  under  ideal  conditions,  tracking  of  reference 
inputs,  and  stabilization  of  unstable  plants.  However,  the  algorithm  was  also  found  to  suffer  from 
convergence  and  robustness  problems,  and  the  assumptions  that  it  required  were  found  to  make  it 
poorly  suited  to  high-order  systems  and  systems  with  unknown  time  delays.  It  was  concluded  that, 
for  active  noise  control  applications,  the  advantages  of  the  internal  model  principle  algorithm  were 
of  little  value,  while  its  disadvantages  made  a  practical  implementation  difficult  if  not  impossible. 
For  this  reason,  further  work  was  not  pursued  along  this  direction. 

In  [15],  a  scheme  proposed  in  a  patent  by  Chaplin  &  Smith  was  analyzed.  The  paper  demon¬ 
strated  that  the  techniques  of  analysis  developed  under  the  grant  could  be  applied  to  Chaplin  fc 
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Smith’s  algorithm,  resulting  in  an  ability  to  predict  the  stability  properties  of  the  algorithm,  select 
the  design  parameters,  and  improve  the  overall  dynamic  response.  It  was  also  found  that  the  direct 
approach  under  study  in  this  project  had  distinguishing  features  and  advantages  over  Chaplin  & 
Smith’s  approach. 

In  the  process  of  surveying  various  approaches  to  periodic  disturbance  rejection,  a  modifica¬ 
tion  of  the  indirect  approach  was  discovered  that  resulted  in  significant  improvements.  Earlier 
simulations  of  the  indirect  algorithm  had  shown  convergence  problems  which  made  the  scheme 
unattractive.  However,  simulations  for  the  modified  algorithm  changed  that  picture  [13].  The  idea 
of  the  modified  algorithm  is  shown  in  Fig.  4,  and  consists  in  subtracting  from  the  plant  output  an 
estimate  of  the  portion  of  the  plant  output  that  is  due  to  the  input  signal. 
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Figure  4:  Indirect  approach  to  periodic  disturbance  cancellation 

Experiments  in  the  lab  using  the  (modified)  indirect  approach  were  very  successful,  with  noise 
reductions  by  an  order  of  magnitude  obtained  for  a  sinusoidal  disturbance.  The  algorithm  was 
extended  to  a  multi-channel  system  and  a  conference  paper  discussing  the  results  appeared  in  1999 
[17].  The  microphone  signals  reported  in  the  paper  are  shown  on  Fig.  5,  and  the  frequency  estimate 
is  shown  in  Fig.  6. 

Research  along  the  direction  of  periodic  disturbance  cancellation  has  continued  after  the  com¬ 
pletion  of  the  grant.  Interestingly,  a  new  frequency  estimation  algorithm  was  developed  based  on 
the  direct  scheme,  and  a  conference  paper  is  being  prepared  for  the  2001  American  Control  Con¬ 
ference.  Our  plan  is  to  integrate  this  frequency  estimation  algorithm  with  the  indirect  adaptive 
scheme  in  order  to  obtain  a  multi-channel,  multi-harmonic  adaptive  cancellation  scheme. 
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1999. 

[16]  M.  Bodson,  “Performance  of  an  Adaptive  Algorithm  for  Sinusoidal  Disturbance  Rejection  in 
High  Noise,”  submitted  for  publication  to  Automatica.  The  paper  is  an  expanded  version  of 
“Cancellation  of  Sinusoidal  Disturbances  with  Unknown  Frequency,”  that  appeared  in  the 
Proc.  of  the  Ninth  Yale  Workshop  on  Adaptive  and  Learning  Systems,  New  Haven,  CT,  pp. 
174-179,  1996 

[17]  B.  Wu  &  M.  Bodson,  ’’Multi-Channel  Active  Noise  Control  for  Periodic  Disturbances,”  Proc. 
of  the  IEEE  Conference  on  Decision  and  Control,  Phoenix,  AZ,  pp.  4971-4975,  1999. 

3.  Scientific  Personnel 

Faculty:  Marc  Bodson  and  Scott  C.  Douglas. 

Students  supported:  David  Nelson,  Jihee  Soh,  Biqing  Wu,  and  Haiping  Wu.  David  S.  Nelson 
completed  his  M.S.  thesis  titled  “Fast  Exact  Block  Adaptive  Algorithms  for  Feedforward  Active 
Noise  Control”  in  1998  and  joined  L3  Communications  Corp.,  Salt  Lake  City,  UT.  Jihee  K.  Soh 
completed  her  M.S.  thesis  at  the  University  of  Utah  and  joined  the  grant  to  work  on  her  Ph.D.  on 
the  topic  of  delay  compensation  methods.  She  passed  the  Ph.D.  qualifying  examinations.  Biqing 
Wu  passed  her  Ph.D.  qualifying  examinations  in  Spring  1999  and  has  been  working  on  her  Ph.D. 
thesis  on  the  topic  of  frequency  estimation  and  active  noise  control.  She  is  expected  to  defend 
her  Ph.D.  thesis  proposal  in  August  2000.  Haiping  Wu  worked  on  the  design  of  adaptive  systems 
for  periodic  disturbance  cancellation  using  linear  time-invariant  equivalence.  He  defended  his  M.S. 
thesis  proposal  shortly  after  the  end  of  the  grant,  in  May  2000,  and  is  expected  to  defend  his 


11 


M.S.  thesis  in  August  2000.  Jonathan  Jensen  was  supported  briefly  on  the  grant,  but  decided  not 
to  continue  working  on  the  project.  His  help  on  developing  the  testbed,  however,  was  invaluable. 
Shayne  Messerly  and  Cameron  Ford  completed  senior  projects  on  topics  related  to  the  grant  without 
salary  support  from  the  grant,  but  using  the  active  noise  control  testbed  and  supervision  from  the 
Pi’s. 


4.  Report  of  Inventions 

A  provisional  patent  entitled,  ’’Method  and  apparatus  for  multi-channel  active  noise  and  vibration 
control,”  was  filed.  The  costs  of  this  application  were  paid  by  an  outside  commercial  firm  that  may 
license  the  technology. 

5.  Technology  Transfer 

On  March  24,  1997,  Profs.  Marc  Bodson  and  Scott  C.  Douglas  visited  the  Structural  Acoustics 
Branch  of  Langley  Research  Center  in  Hampton,  Virginia.  In  the  morning,  Drs.  Bodson  and 
Douglas  held  meetings  with  Dr.  Richard  Silcox  and  Dr.  Karen  Lyle  of  NASA  Langley  Research 
Center,  in  which  they  discussed  their  current  work  on  active  noise  and  vibration  control  algorithms. 
In  the  afternoon,  they  gave  a  joint  talk  entitled,  ’’Novel  Feedforward  and  Feedback  Algorithms  for 
Active  Noise  Control.”  Afterwards,  Drs.  Silcox  and  Lyle  provided  Drs.  Bodson  and  Douglas  a  tour 
of  the  experimental  facilities  of  the  Structural  Acoustics  Branch  at  NASA  Langley. 

Approximately  20  researchers  attended  the  talk,  and  the  results  stimulated  a  large  number 
of  questions  and  comments.  Because  a  multichannel  active  noise  control  system  was  currently 
under  development  at  NASA  Langley,  the  researchers  expressed  a  particular  interest  in  the  efficient 
implementation  of  the  filtered-X  LMS  algorithm.  Following  the  visit,  Dr.  Douglas  was  contacted  by 
Randolph  Cabell,  a  researcher  at  NASA  Langley  on  leave  from  Virginia  Polytechnic  Institute  and 
State  University  (Virginia  Tech),  who  inquired  about  the  efficient  multi-channel  filtered-X  LMS 
algorithm  developed  under  the  Army  Research  Office  grant. 

On  March  25,  1997,  Drs.  Bodson  and  Douglas  visited  the  Thomas  Lord  Research  Center  of 
Lord  Corporation,  Cary,  North  Carolina.  Lord  Corporation  is  a  manufacturer  of  adhesives,  mounts, 
and  active  noise  and  vibration  control  systems.  The  visit  to  Lord  Corporation  was  hosted  by  Drs. 
Steve  Southward  and  Lane  Miller.  The  talk  generated  significant  interest  in  both  the  feedforward 
and  feedback  algorithms  under  development  at  the  University  of  Utah.  Afterwards,  Dr.  Steve 
Southward  and  Dr.  Lane  Miller  of  Lord  Corporation  gave  a  tour  of  the  laboratories  where  active 
noise  and  vibration  control  research  and  development  is  underway.  From  this  visit,  it  appeared  that 
Lord  Corporation  had  many  advanced  developments  underway,  and  there  was  potential  for  future 
cooperation  in  the  commercialization  of  active  noise  and  vibration  control  systems  for  aeronautical 
applications. 
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I.  INTRODUCTION 

Interest  in  active  methods  for  the  suppression  of  noise  and  vibration  has  grown  recently,  as  ev¬ 
idenced  by  the  numerous  review  articles  and  books  that  have  appeared  on  the  subject  [l]— F9j. 
Although  the  potential  for  active  noise  and  vibration  control  has  long  been  recognized  [10],  suc¬ 
cessful  implementations  of  these  techniques  have  begun  to  appear  only  recently.  Such  success  can 
be  attributed  to  the  rapid  maturation  of  technology  in  three  areas:  (i)  novel  electroacoustic  trans¬ 
ducers,  (ii)  advanced  adaptive  control  algorithms,  and  (iii)  inexpensive  and  reliable  digital  signal 
processing  (DSP)  hardware.  As  advances  in  these  areas  are  developed,  active  suppression  of  noise 
and  vibration  can  be  expected  to  find  wider  use  in  a  number  of  commercial,  industrial,  and  military 
applications.  In  our  discussion,  we  focus  on  the  algorithms  used  in  multichannel  active  noise  and 
vibration  control  systems  as  implemented  in  DSP  hardware. 

Perhaps  the  most  popular  adaptive  control  algorithm  used  in  DSP  implementations  of  active 
noise  and  vibration  control  systems  is  the  filtered-X  least-mean-square  (LMS)  algorithm.  There 
are  several  reasons  for  this  algorithm’s  popularity.  Firstly,  it  is  well-suited  to  both  broadband  and 
narrowband  control  tasks,  with  a  structure  that  can  be  adjusted  according  to  the  problem  at  hand. 
Secondly,  it  is  easily  described  and  understood,  especially  given  the  vast  background  literature  on 
adaptive  filters  upon  which  the  algorithm  is  based  [11,  12].  Thirdly,  its  structure  and  operation  are 
ideally  suited  to  the  architectures  of  standard  DSP  chips,  due  to  the  algorithm’s  extensive  use  of  the 
multiply/accumulate  (MAC)  operation.  Fourthly,  it  behaves  robustly  in  the  presence  of  physical 
modelling  errors  and  numerical  precision  effects  caused  by  finite-precision  calculations.  Finally,  it 
is  relatively  simple  to  set  up  and  tune  in  a  real-world  environment. 

Despite  its  popularity,  the  filtered-X  LMS  algorithm  suffers  from  one  drawback  that  makes  it 
difficult  to  implement  when  a  multichannel  controller  is  desired:  the  complexity  of  the  coefficient 
updates  for  the  finite-impulse-response  (FIR)  filters  within  the  controller  in  these  situations  is 
often  much  greater  than  the  complexity  of  the  input-output  calculations.  It  is  not  unusual  for 
the  coefficient  updates  to  require  more  than  ten  times  the  number  of  MACs  needed  to  compute 
the  outputs  of  the  controller  for  fixed  coefficient  values,  and  the  situation  worsens  as  the  number 
of  error  sensors  is  increased.  For  this  reason,  recent  efforts  have  focused  on  ways  to  reduce  the 
complexity  of  the  filtered-X  LMS  algorithm  in  a  multichannel  context.  Suggested  changes  include: 
(i)  block  processing  of  the  coefficient  updates  using  fast  convolution  techniques  [13],  (iij  partial 
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updating  of  the  controller  coefficients  [14],  and  (iii)  filtered-error  methods  [15,  16].  While  useful, 
these  methods  often  reduce  the  overall  convergence  performance  of  the  controller,  either  because 
they  introduce  additional  delays  into  the  coefficient  update  loop  or  because  they  throw  away  useful 
information  about  the  state  of  the  control  system.  Such  a  performance  loss  may  not  be  tolerable 
in  some  applications. 

In  addition  to  these  computational  difficulties,  the  multichannel  filtered-X  LMS  algorithm  also 
suffers  from  excessive  data  storage  requirements.  This  algorithm  employs  filtered  input  signal  values 
that  are  created  by  filtering  every  input  signal  by  every  output-actuator-to-error-sensor  channel  of 
the  acoustic  plant.  The  number  of  these  terms  can  be  an  order-of-magnitude'  greater  than  the 
number  of  controller  coefficients  and  input  signal  values  used  in  the  input-output  calculations.  As 
typical  DSP  chips  have  limited  on-chip  memory,  system  designers  may  be  forced  to  use  costly  off- 
chip  memory  within  their  controller  architectures  that  can  further  slow  the  operation  of  the  system 
due  to  limits  in  input/output  data  throughput.  While  some  of  the  aforementioned  techniques 
for  complexity  reduction  also  have  reduced  memory  requirements,  the  performance  of  the  overall 
system  is  effectively  limited  by  these  methods. 

In  this  paper,  we  present  an  alternative  method  for  reducing  the  computational  and  memory 
requirements  of  tile  multichannel  filtered-X  LMS  adaptive  controller.  Our  solution  is  an  alternative 
implementation  of  this  system  that  is  mathematicallv-equivalent  to  the  original  implementation, 
and  thus  it  preserves  the  characteristic  robust  and  accurate  behavior  of  the  filtered-X  LMS  algo¬ 
rithm.  However,  the  complexity  and  memory  requirements  of  the  new  implementation  are  signif¬ 
icantly  reduced  over  those  of  the  original  implementation,  especially  for  controllers  which  a  large 
number  of  channels.  Moreover,  since  the  filtered-input  signals  are  never  formed  in  our  implemen¬ 
tation,  the  excessive  memory  requirements  of  the  original  implementation  are  avoided. 

In  what  follows,  we  first  describe  the  alternate  implementation  of  the  filtered-X  LMS  algorithm 
in  the  single-channel  case  for  simplicity,  even  though  the  implementation’s  computational  savings 
are  only  realized  in  the  multichannel  case.  As  for  mathematical  notation,  scalar  variables  are 
employed  throughout  to  enable  the  algorithm’s  direct  translation  to  processor  code,  and  indices  of 
parameter  sets  are  for  the  most  part  lower-case  versions  of  the  variable  designating  the  number  of 
parameters;  e.g.  hm  for  1  <  m  <  M. 

II.  THE  FILTERED-X  LMS  ALGORITHM 

To  simplify  our  discussion,  we  initially  present  the  single-channel  filtered-X  LMS  adaptive  feed¬ 
forward  controller;  the  multichannel  filtered-X  LMS  algorithm  is  described  in  Section  IV.  Figure  1 
shows  a  block  diagram  of  this  system.  In  this  system,  a  sensor  placed  near  a  noise  source  collects 
samples  of  the  input  signal  x(n)  for  processing  by  the  system.  This  system  computes  an  actuator 
output  signal  y(n)  using  a  time- varying  FIR  filter  of  the  form 

L-i 

y{n )  =  w/(n)z(n -/),  ^ 

1=0 

where  wL(n),  0  <  l  <  L  -  1  are  the  controller  coefficients  and  L  is  the  controller  filter  length.  The 
acoustic. output  signal  produced  by  the  controller  combines  with  the  noise  signal  as  it  propagates 
to  the  desired  quiet  region,  where  an  error  sensor  collects  the  combined  signal.  We  can  model  this 
error  signal  as 

•  OO 

«(n)  =  d(n)  +  53  h™y(n  -  m)> 
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Figure"!:  A  feedforward  filtered-X  LMS  adaptive  controller. 


where  d(n)  is  the  unattenuated  noise  signal  and  /im,  — oo  <  m  <  oo  is  the  plant  impulse  response. 
Note  that  (2)  is  never  computed  as  e(n)  is  a  measurement  of  a  physical  quantity. 

The  filtered-X  LMS  coefficient  updates  are  given  by 

wi(n  +  l)  =  wi(n)  —  fi(n)e(n)f(n  -  /),  (3) 

where  the  filtered  input  sequence  f(n)  is  computed  as 

M 

f{n)  =  Y2  hmX{n  -  m),  (4) 

771=1 

and  M  is  the  FIR  filter  length  of  an  appropriate  estimate  of  the  plant  impulse  response.  In  practice, 
the  values  of  hm  used  in  (4)  are  estimates  of  the  actual  hm  in  (2)  and  are  usually  obtained  in  a 
separate  estimation  procedure  that  is  performed  prior  to  the  application  of  control.  For  notational 
simplicity,  we  will  not  distinguish  the  differences  in  these  two  parameter  sets  in  what  follows. 

A  study  of  (1),  (3),  and  (4)  shows  that  the  filtered-X  LMS  algorithm  requires  2 L  +  M  +  1 
multiply/add  operations  and  2 L  +  max{L,M  +  1}  +  1  memory  locations  to  store  the  necessary 
tu/(n),  hm,  x(n-/),  and  /(n-/)  for  the  algorithm  at  each  step.  For  typical  choices  of  the  controller 
and  plant  filter  lengths,  the  complexity  and  memory  requirements  of  this  algorithm  are  reasonable. 
As  will  be  shown  later,  however,  such  is  not  the  case  for  the  natural  extension  of  this  algorithm  to 
the  multichannel  control  task. 


III.  AN  ALTERNATE  IMPLEMENTATION  OF  THE  FILTERED-X  LMS 

ALGORITHM 


We  now  describe  a  new  implementation  of  the  single-channel  filtered-X  LMS  algorithm  [17].  This 
method  combines  the  recently-introduced  adjoint  LMS  algorithm  of  Wan  [16]  with  a  recently- 
developed  method  for  delay  compensation  that  first  appeared  in  fast  projection  adaptive  filters 
[18?  19].  To  derive  the  implementation,  we  can  write  the  coefficient  updates  of  the  original  version 
of  the  algorithm  in  the  form 

M 

u;f(rc+l)  =  wi(n)  -  fi(n)e(n)  hmx(n  -  /  -  m).  (5) 

m=l 

Define  sm(n)  for  1  <  m  <  M  as 

£m{n)  =  hmfi(n)e(n).  (6) 


Then,  (5)  becomes 


M 

-  ^£m(n)i(n-  /  -  m). 
m=l 


wi(n  + 1)  =  wi(n) 


(7) 
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We  can  represent  the  relation  in  (7)  for  M  successive  time  steps  as 

M- 1  M 

u»,(n  +  l)  =  w/(n-M+l)-  J 


(8) 


p=0  m  =  l 


We  can  expand  the  summation  on  the  right-hand-side  of  (8)  in  a  particularly  useful  way  as 


u;/(n  +  l)  =  wi(n) 

—  £\ (n)x(n  — /  — 1)  —  £2{n)x(n  ~  l  ~  2) 

-  £i(n  -  l)x(n  -  /  -  2) 


where  we  define  the  /th  auxiliary  coefficient  wi(n )  as 


SA/(n)x(n  -  l-  M) 


-  £M- i{n  -  l)x(n  -  l  -  M) 


.,(9) 


-  £i(n  -  M  +  l)x(n  -  /  -  M) 


A/-1  M 

wi{n )  =  ti7/(n  -  M  +  1)  -  E  E  ~  ‘V/  +  m  -  p)x(n 

p=l  m=p+ 1 


(10) 


The  expression  in  (9)  indicates  an  important  fact  about  the  structure  of  the  filtered  X  uMS 
updates:  the  same  input  signals  x{n  -  l  -  m)  are  used  in  successive  time  instants  to  update  the 
same  coefficient  w,(n).  Such  a  result  is  readily  apparent  from  (9),  as  each  column  of  update  terms 
on  the  right-hand-side  of  (9)  depends  on  a  single  input  signal  value.  We  can  exploit  this  st  ructure 
to  develop  a  set  of  coefficient  updates  that  are  grouped  according  to  the  individual  x(n  -  /  -  m) 
values  appearing  on  the  right-hand-side  of  (9).  Such  a  scheme  updates  the  l th  auxiliary  coefficient 
wi(n)  rather  than  the  actual  controller  coefficient  wi(n).  Define  em(n)  as  the  sum  of  the  error  terms 
premultiplying  the  columns  of  i(n  -  l  —  m)  on  the  right-hand-side  of  (9)  as 


fim(n)  =  J2£P{n-m  +  p). 

p= i 

Then,  it  is  straightforward  to  show  that  wi(n)  can  be  updated  as 

wi(n  +  1)  =  wi(n)  —  e_\r(n)x(n  —  M 


l). 


(11) 


(12) 


Thus,  i di (n  +  1)  is  obtained  by  subtracting  from  wi(n)  the  last  column  of  update  terms  on  the 

right-hand-side  of  (9).  . 

Note  that  eM(n)  is  a  signal  obtained  by  filtering  p{n)e(n)  by  the  time-reversed  plant  impulse  re¬ 
sponse  {hM,  hM- 1,  . . .,  hi},  such  that  the  coefficient  update  for  toj(n)  is  the  single-channel  version 
of  the  adjoint  LMS  algorithm  described  by  Wan  [16].  What  is  novel  is  the  relationship  in  (9),  which 
provides  the  link  between  toj(n)  and  «7/(n),  or,  equivalently,  the  link  between  the  adjoint  LMS  and 
filtered-X  LMS  algorithms.  We  can  use  this  expression  to  determine  a  method  for  computing  y[n) 
for  the  filtered-X  LMS  algorithm  using  the  w ;(n)  obtained  from  the  adjoint  LMS  algorithm.  To 
proceed,  we  substitute  the  expression  for  wi(n  + 1)  in  (7)  into  (9).  Using  (11)  to  simplify  the  result, 
we  obtain 

M-l 

wi(n)  =  . W[(n)  —  ^  em(n  —  l)x(n  —  /  —  m  —  1).  (13) 

m=l 

We  now  consider  the  controller  output  calculation  in  (1).  Substituting  .the  expression  for  w,{n)  in 
(13)  into  (1),  we  produce  the  equivalent  expression 
L-l  L-lM-1 

y(n)  =  y;  wi(n)x(n  -  l)  —  T}  em(n  -  l)x(n  -  /  -  m  -  l)x(n  -  /)• 

/— o  /=0  m=l 


(14) 
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Equation 

MACs 

for  m  =  1  to  M  -  1  do 

**m(ra)  =  rm(n  -  1)  +  x(n)x(n  -  m  -  1)  -  x(n  -  L)x(n  -  L  -  m  -  1) 

2M  -  2 

end 

L-i  M-i 

y(n)  =  2^wt(n)x(n-I)  -  Zem(n-l)rm(n) 

L  +  M 

1=0  m= 1 

eM(n)  =  /x(rc)«(rc) 

1 

ei(n)  =  hi  e^(n) 

1 

for  m  =  1  to  M  —  1  do 

=  “  1)  ^m-f 

M  -  1 

end 

for  /  =  0  to  L  -  1  do 

wi(n  +  1)  =  wi(n)  -  eiv/(n)x(n  -  M  -  /) 

L 

end 

Total:  2 L  +  AM  -  1 

Table  1:  An  alternative  filtered-X  LMS  algorithm. 


Define  the  correlation  term  rm  (n)  as 


L—l 


rm(n)  —  Y  x(n  -  /  -  m  -  l)x(n  -  /). 
l=o 


Then,  (14)  becomes 


L—l 


M- 1 


y(n )  =  ^®i(ii)i(n-i)-^em(n-l)rm(ii). 


(15) 


(16) 


Such  a  calculation  is  of  reasonable  complexity  because  of  the  sliding-window  nature  of  the  correla¬ 
tion  term  rm(n ),  which  allows  it  to  be  recursively  updated  as 

rm(n)  =  rm(n  —  1)  +  x(n)x(n  —  m  —  1)  —  x(n  —  L)x(n  —  L  —  m  —  1).  (17) 

Moreover,  em(n)  has  a  simple  order-recursive  update  of  the  form 

/  hie^n)  if  m  =  1 


em{n) 


where 


em-i(n  -  1)  +  hmen(n)  if  2  <  m  <  M  ' 
eti{n)  =  /i(n)e(n). 


(18) 


(19) 


Collecting  (12),  (16),  (17),  (18),  and  (19),  we  obtain  a  consistent  set  of  equations  that  exactly 
computes  the  output  signal  of  the  filtered-X  LMS  adaptive  controller.  Table  1  lists  the  operations 
for  this  new  version  of  the  algorithm  as  well  as  the  number  of  multi  ply /accumulates  (MACs)  needed 
to  implement  each  operation  at  each  iteration.  Since  the  total  number  of  MACs  is  2 L  +  AM  -  1, 
this  algorithm  is  more  computationally-complex  than  the  original  implementation  of  the  filtered-X 
LMS  algorithm,  which  only  requires  2L  +  M  + 1  MACs  per  iteration.  However,  in  the  multichannel 
case,  the  alternative  implementation  can  save  operations  and  memory  storage,  as  we  shall  soon 
show. 
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IV.  THE  MULTICHANNEL  FILTERED-X  LMS  ALGORITHM 

We  now  describe  the  multichannel  version  of  the  filtered-X  LMS  algorithm  in  its  original  imple¬ 
mentation  [7,  8].  In  multichannel  control,  /  input  sensors  are  used  to  collect  I  input  signals  \n), 
1  <i<  I.  The  controller  computes  J  output  signals  y(j)(n),  1  <  j  <  J  as 

y^(n)  =  ^2  Y  -  /),  (20) 

•  •  i=i  t=o 

where  w\i,j\n),  0  <  l  <  L  -  1  are  the  L  FIR  filter  coefficients  for  the  ith-input-to-jth-output 
channel  of  the  controller.  The  J  controller  output  signals  propagate  to  the  desired  quiet  region, 
where  I<  error  sensors  measure  the  error  signals  €W(n),  1  <  k  <  I<  as 

i(k\i a)  =  d{k)[n)  +  J2  Y  hm'k)y{3)(n  ~  m),  (2L) 


and  hm’k\  -oo  <  m  <  oo  is  the  impulse  response  of  the  jth-output-to-fcth-error  channel  of  the 
acoustic  plant. 

To  update  in  the  original  filtered-X  LMS  algorithm,  IJK  filtered  input  signals  pl'3'K]{n) 

are  computed  as 


M 

/(*••'.*) (n)  =  ST  h^x^(n  -  m), 

m  =  I 


(22) 


from  which  ioj,,J^(ra)  is  updated  as 


Wi'i\n  +  1) 


k=  1 


(23) 


where 

e^(n)  =  n(n)e^(n).  (24) 

A  careful  study  of  the  filtered-X  LMS  algorithm  described  by  (20),  (22),  (23),  and  (24)  re¬ 
veals  the  fact  that  this  implementation  requires  IJK{L  +  M)  +  K  MACs  to  compute  the  coeffi¬ 
cient  updates,  even  though  computing  the  controller  outputs  only  requires  IJL  MACs.  Thus,  the 
complexity  of  the  update  calculations  is  more  than  K  times  the  complexity  of  the  input-output 
calculations.  For  systems  with  a  large  number  of  error  sensors,  the  computational  burden  of  the 
coefficient  updates  can  overwhelm  the  capabilities  of  the  processor  chosen  for  the  control  task. 

The  standard  implementation  of  the  filtered-X  LMS  algorithm  also  has  memory  requirements 
that  can  exceed  the  capabilities  of  a  chosen  processor.  The  total  storage  needed  is  IJ(K  T  1)L  T 
JKM  +  Imzx.(L,  M+l)  +  I<,  and  for  long  controller  filter  lengths,  the  bulk  of  this  storage  is  for  the 
IJKL  filtered  input  signals  /(*•■»'•*) (n  —  /) .  Clearly,  it  is  desirable  to  find  alternative  implementations 
of  the  filtered-X  LMS  algorithm  that  have  reduced  computational'  and  memory  requirements.  We 
now  present  one  such  algorithm  that  is  based  on  the  method  described  in  Section  111. 
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V.  A  MULTICHANNEL  FILTERED-X  LMS  ALGORITHM  WITH  REDUCED 

COMPLEXITY 


We  consider  the  multichannel  extension  of  the  new  version  of  the  filtered-X  LMS  algorithm  in 
Section  III.  To  determine  the  appropriate  grouping  of  terms  for  the  updates,  we  substitute  the 
expression  for  /('d.*)  (n  _  jn  (22)  into  the  update  in  (23)  to  get 

K  M 

tcf’+n  +1)  =  (n)  -  eikHn)  J2  hmk)*(,)(n  -l-m)  /  (25) 

/:=  1  m=l 

M 

=  -  2 3  £m\n)x^'Hn  ~  l  ~  m)>  (2d) 

m=  1 

where  we  have  defined  the  JM  terms  5m  (n)  for  1  <  j  <  J  and  1  <  m  <  M  as 

e$(n)  =  (27) 

fc=i 

Comparing  (26)  with  (7),  they  are  seen  to  be  of  a  similar  form.  Thus,  we  can  use  a  method 
analogous  to  that  in  Section  III  to  implement  the  multichannel  filtered-X  LMS  algorithm.  For  this 
implementation,  we  define  the  JM  terms  (n)  as 


em{n)  =  Yj£p](n~  171 +  P)- 

P=1 

Then,  we  can  define  a  set  of  IJL  auxiliary  coefficients  w\h^(n)  whose  updates  are  given  by 


it? 


(*»i) 


(ra  +  l)  =  -  e$(n)x^(n  -  M  -  /). 


To  compute  the  controller  outputs,  the  multichannel  equivalent  of  (16)  is 

/  L-i  Af-i 

yU)(n)  =  J2  H  «{‘j)(»)*W(»  -  0  -  J2  em(n  -  1  )rm(n), 

i-l  l-Q 

where  rm(n)  in  this  case  is  defined  as 

I  L-l 


m—  1 


rm(n)  =  y  22  x^Hn  ~  l)x^(n  —  l  -  m  -  1). 
-  i=i  1=0 


(28) 


(29) 


(30) 


(31) 


In  analogy  with  (17),  rm(n)  can  be  recursively  computed  as 

/ 

rm(n)  =  rm(n  —  1)  +  y  fgO(n)x^(n  —  m  —  1)  —  x^l\n  -  L)x^(n  -  L  -  m  —  1))  (32) 

«'=i 


to  minimize  the  number  of  operations  per  time  instant.  Similarly,  (n )  has  an  update  similar  to 

that  in-  (18)  as  given  by 


em)  (n)  =  \ 


.K 


if  m  —  1 


k-l 

-Ci) 


a: 


«2-i  (»  -  1)  +  J2h%%k)  (»)  ^  2  <m<M 


(33) 
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for  m  =  1  to  M  —  1  do 


,(n)  =  rm(n  —  1)  +  ^  ^')(n)x^(n  -  m  -  1)  -  x^‘^(n  -  L)x^(n  -  L  -  m  -  l)j  2 1(M  -  1) 


end 

for  j  =  1  to  J  do 

I  L- 1  M- 1 

yuHn)  =  ]LE5i’An)z(i)(n-*)  ~  -  i)rm(n) 

»=1  /=0  "»=1 

end 

for  k  =  1  to  K  do 

4fc)(n)  =  ti{n)e(k){n) 
end 

for  j  =  1  to  J  do 


e(ij)(n)  =  Y^lii'k)^k)(n) 
k=\ 

for  m  —  1  to  A/  —  1  do 


emi-i(n)  =  era(n  -  1)  +  J2hyn+[^'{^) 
end 

for  i  =  1  to  /  do 

for  /  =  0  to  L  -  1  do 

=  w]tJ\n)  -  e^f\ii)x^t}(n  -  M  -  l) 

end 

end 

end 

Total:  21 JL  +  JKM  +  (2I  +  J)(A/  -  1)T K 


IJL  +  J(M  -  1) 


JI\IM  -  l) 


Table  2:  A  multichannel  filtered-X  LMS  algorithm  with  reduced  complexity. 


Collecting  (24),  (29),  (30),  (32),  and  (33),  we  obtain  an  alternative,  equivalent  implementation 
of  the  multichannel  filtered-X  LMS  algorithm.  Table  2  lists  the  operations  of  this  implementation, 
along  with  the  number  of  MACs  required  to  implement  each  operation.  The  algorithm  employs 
2 IJL  +  JKM  +  (27  +  J){M  -  1)  +  K  MACs  per  iteration,  and  it  requires  IJL  +  JKM  +  IL  + 
(7  +  J  +  1)M  +  K  -  1  memory  locations  to  implement. 

VI.  COMPLEXITY  COMPARISONS 

We  now  compare  the  computational  and  memory  requirements  of  the  original  and  new  implemen¬ 
tations  of  the  multichannel  filtered-X  LMS  algorithms.  In  this  comparison,  we  consider  systems 
with  different  numbers  of  input  sensors,  output  actuators,  and  error  sensors  under  three  different 
problem  scenarios.  Each  scenario  is  defined  by  specific  choices  of  the  controlleT  filter  length  L  and 
plant  model  filter  length  M  that  would  be  appropriate  for  a  particular  type  of.noise  or  vibration 
control  task.  In  each  case,  we  present  the  quantities  R ^  and  72 that  denote  the  ratios  of 
the  numbers,  of  MACs  and  memory  locations,  respectively,  required  by  the  new  implementation 
of  the  multichannel  filtered-X  LMS  algorithm  with  respect  to  the  numbers  of  MACs  and  memory 
locations  needed  for  the  algorithm’s  original  implementation.  For  comparison,  we  also  provide  the 
ratios  72 ^  and  72^^  for  the  multichannel  adjoint  LMS  algorithm  [16]  with  respect  to  the  original 
multichannel  filtered-X  LMS  algorithm.  Since  the  adjoint  LMS  algorithm  equations  are  used  within 
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1 

# 

Complexity 

Memory 

# 

Complexity 

Memory 

Channels 

Ratio 

Ratio 

Channels 

Ratio 

Ratio 

i 

j 

K 

Rf 

d(C) 

Tip 

i 

J 

K 

4C> 

R.W 

i 

2 

2 

0.7512 

0.9900 

0.7235 

0.7765 

4 

6 

4 

0.3574 

0.3974 

0.3313 

0.3348 

i 

3 

2 

0.7508 

0.9502 

0.6933 

0.7301 

2 

6 

6 

0.3506 

0.3906 

0.3469 

0.3515 

i 

4 

2 

0.7506 

0.9302 

0.6772 

0.7054 

2 

8 

6 

0.3505 

0.3865 

0.3412 

0.3446 

i 

6 

2 

0.7504 

0.9101 

0.6605 

0.6797 

2 

8 

8 

0.3082 

0.3359 

0.3096 

0.3123 

2 

2 

2 

0.6259 

0.8055 

0.6259 

0.6559 

4 

8 

8 

0.2311 

0.2495 

0.2288 

0.2303 

2 

3 

2 

0.6256 

.0.7654 

0.5877 

0.6085 

8 

8 

8 

0.1925 

0.2063 

0.1820 

0.1828 

2 

4 

2 

0.6255 

0.7453 

0.5672 

0.5832 

4 

8 

12 

0.1845 

0.1972 

0.1927 

0.1937 

2 

6 

2 

0.6253 

0.7252 

0.5459 

0.5568 

4 

12 

12 

0.1844 

0.1949 

0.1888 

0.1895 

1 

4 

4 

0.5726 

0.6752 

0.5358 

0.5523 

4 

16 

12 

0.1844 

0.1938 

0.1869 

0.1874 

1 

6 

4 

0.5722 

0.6635 

0.5241 

0.5353 

8 

8 

12 

0.1449 

0.1544 

0.1444 

0.1449 

2 

3 

3 

0.5009 

0.6025 

0.4928 

0.5085 

8 

8 

16 

0.1202 

0.1274 

0.1244 

0.1248 

1 

4 

6 

0.5015 

0.5733 

0.4771 

0.4888 

8 

12 

16 

0.1201 

0.1257 

0.1211 

0.1214 

3 

3 

3 

0.4552 

0.5424 

0.4490 

0.4601 

8 

16 

16 

0.1201 

0.1249 

0.1195 

0.1197 

3 

6 

3 

0.4549 

0.5130 

0.4111 

0.4168 

8 

32 

16 

0.1200 

0.1236 

0.1170 

0.1171 

2 

4 

4 

0.4294 

0.4979 

0.4209 

0.4305 

16 

16 

16 

0.1000 

0.1036 

0.0926 

0.0927 

2 

6 

4 

0.4291 

0.4862 

0.4060 

0.4125 

16 

32 

16 

0.1000 

0.1024 

0.0901 

0.0901 

2 

8 

4 

0.4290 

0.4804 

0.3985 

0.4033 

8 

16 

32 

0.0817 

0.0842 

0.0901 

0.0903 

4 

4 

4 

0.3576 

0.4090 

0.3484 

0.3536 

16 

16 

32 

0.0613 

0.0631 

0.0625 

0.0625 

2 

4 

6 

0.3510 

0.3989 

0.3582 

0.3651 

32 

32 

32 

0.0510 

0.0520 

0.0466 

0.0466 

Table  3:  Complexity  comparison,  L  =  50,  M  ~  25. 

the  new  filtered-X  LMS  algorithm  implementation,  we  have  that  R <  R and  R^  <  R^\ 
although  the  requirements  of  these  two  algorithms  are  similar  for  systems  with  a  large  number  of 
channels. 

The  first  situation  considered  is  a  broadband  noise  control  task  in  which  the  controller  and 
plant  model  filter  lengths  are  L  =  50  and  M  =  25.  These  choices  are  typical  for  this  type  of  control 
problem  and  offer  a  reasonable  balance  between  the  performance  and  robustness  of  the  controller 
in  this  situation  for  fixed  hardware  resources.  Table  3  shows  the  complexity  and  memory  ratios 
for  the  different  cases  considered.  As  can  be  seen  for  all  of  the  cases  considered,  the  number  of 
multiplies  required  for  the  new  implementation  of  the  multichannel  filtered-X  LMS  algorithm  is 
less  than  that  of  the  original  algorithm,  and  this  difference  is  significant  for  systems  with  a  large 
number  of  channels.  In  fact,  for  an  TV-input,  TV-output,  TV-error  system,  the  complexity  of  the 
new  implementation  is  approximately  80%  of  the  original  implementation  when  TV  =  2,  40%  of  the 
original  when  TV  =  4,  20%  of  the  original  when  N  =  8,  and  10%  of  the  original  when  TV  =  16. 
In  addition,  the  number  of  memory  locations  required  by  the  new  implementation  is  also  reduced 
and  is  less  than  10%  of  the  original  algorithm’s  memory  requirements  for  I  =  J  =  K  =  TV  =  16. 
These  savings  are  significant,  as  they  allow  a  multichannel  control  system  to  be  implemented  on  a 
much-simpler  hardware  platform. 

We  now  consider  a  narrowband  control  task  in  which  L  =  2  and  M  =  10.  Such  a  situation  is 
typical  of  narrowband  noise  control  problems  in  which  each  input  signal  is  a  single  sinusoid  of  a 
different  frequency;  thus,  each  channel  of  the  controller  is  dedicated  to  one  tonal  component  of  the 
unwanted  noise  or  vibration  acoustic  field.  Table  4  lists  the  ratio  of  MACs  and  memory  locations 
for  the  two  algorithms  with  respect  to  the  original  filtered-X  LMS  algorithm  in  this  situation.  As 
can  be  seen,  except  for  systems  with  a  small  number  of  channels,  the  new  implementation  of  the 
filtered-X  LMS  algorithm  requires  only  a  fraction  of  the  MACs  and  memory  locations  used  by  the 
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# 

1 

Complexity 

Memory 

Channels 

Ratio 

Ratio 

i 

j 

K 

d(C) 

rip 

p(A») 

lip 

2 

2 

2 

0.5472 

1.0566 

1.0682 

1.1705 

2 

3 

2 

0.5443 

0.9430 

1.0667 

1.1417 

2 

4 

2 

0.5429 

0.8857 

1.0658 

1.1250 

2 

2 

4 

0.4902 

0.7549 

0.9315 

0.9932 

2 

4 

4 

0.4851 

0.6634 

0.9173 

0.9511 

2 

6 

4 

0.4834 

0.6325 

0.9119 

0.9352 

2 

‘6 

6 

0.4631 

0.5638 

0.8525 

0.8687 

2 

6 

8 

0.4527 

0.5287 

0.8209 

0.8333 

4 

6 

4 

0.2824 

0.3870 

0.7576 

0.7746 

4 

8 

6 

0.2586 

0.3193 

0.6933 

0.7025 

4 

8 

8 

0.2468 

0.2926 

0.6625 

0.6696 

# 

1 

Complexity 

Memory 

Channels 

Ratio 

Ratio 

i 

J 

K 

rT 

rip 

AM) 
th i _ 

p(M) 

Up 

6 

12 

6 

0.1901 

0.2306 

0.0.5900 

0.5950 

6 

6 

12 

0.1663 

0.1970 

0.5398 

0.5450 

6 

12 

12 

0.1653 

0.1859 

0.5274 

0.5301 

8 

16 

12 

0.1307 

0.1461 

0.4570 

0.4587 

8 

12 

16 

0.1245 

0.1380 

0.4433 

0.4450 

8 

16 

16 

0.1243 

0.1359 

0.4401 

0.4414 

8 

16 

24 

0.1178 

0.1256 

0.4227 

0.4236 

8 

16 

32 

0.1146 

0.1204 

0.4138 

0.4145 

16 

32 

16 

0.0723 

0.0781 

0.2937 

0.2941 

16 

16 

32 

0.0625 

0.0669 

0.2707 

0.2711 

16 

32 

32 

0.0623 

0.0652 

0.2669 

0.2671 

Table  4:  Complexity  comparison,  L  =  2,  M  -  10. 


# 

Channels 
I  I  J  I  K 


Complexity 

Memory 

# 

Complexity 

Memory 

Pnhn 

Ratio 

j  Channels  j 

Ratio 

Ratio 

R\] 

R(C) 

rt  p 

p(Af) 

it  p 

i 

J 

K 

nA _ 

Rf1 

0.5745 

0.9787 

0.9098 

0.9877 

6 

12 

6 

0.2109 

0.2442 

0.3911 

0.3940 

0.5735 

0.8886 

0.8779 

0.9331 

6 

6 

12 

0.1629 

0.1886 

0.3375 

0.3405 

0.5730 

0.8434 

0.8604 

0.9032 

6 

12 

12 

0.1625 

0.1796 

0.3257 

0.3273 

0.4656 

0.6832 

0.7488 

0.7956 

8 

16 

12 

0.1354 

0.1482 

0.2755 

0.2764 

0.4636 

0.6092 

0.7102 

0.7350 

8 

12 

16 

0.1227 

0.1341 

0.2603 

0.2613 

0.4629 

0.5844 

0.6963 

0.7131 

8 

16 

16 

0.1227 

0.1324 

0.2578 

0.2585 

0.4226 

0.5057 

0.6381 

0.6499 

8 

16 

24 

0.1098 

0.1163 

0.2394 

0.2398 

0.4016 

0.4648 

0.6067 

0.6158 

8 

16 

32 

0.1033 

0.1082 

0.2299 

0.2303 

0.3086 

0.3937 

0.5452 

0.5560 

16 

32 

16 

0.0817 

0.0865 

0.1690 

0.1692 

0.2639 

0.3138 

0.4760 

0.4818 

16 

16 

32 

0.0620 

0.0656 

0.1434 

0.1436 

0.2408 

0.2787 

0.4440 

0.4485 

16 

32 

32 

0.0619 

0.0644 

0.1409 

0.1410 

Table  5:  Complexity  comparison,  L  =  10,  M  -  20. 


original  implementation,  and  this  fraction  is  reduced  as  the  number  of  channels  is  increased.  us^ 
the  new  algorithm  implementation  reduces  the  controller’s  hardware  complexity  in  narrowband 

control  situations  as  well.  ..  ,  r  _  ,n  j 

The  third  problem  scenario  considered  is  a  feedforward  control  task  in  which  L  -  10  a 
M  =  20.  These  choices  are  typical  for  noise  and  vibration  control  tasks  in  which  the  input  signals 
are  measured  by  physical  sensors,  but  the  primary  goal  of  the  controller  is  to  attenuate  a  rela  ive  v 
few  number  of  tonal  components  in  the  desired  quiet  region.  Table  5  lists  the  respective  complexi  y 
and  memory  usage  ratios  for  the  different  algorithms  for  different  cases.  As  in  the  previous  cases,  we 
find  that  the  new  implementation  of  the  filtered-X  LMS  algorithm  save  computations  and  memory 
locations,  and  the  savings  is  significant  for  systems  with' a  large  number  of  channels. 

VII.  NUMERICAL  ISSUES' 

In  this  section,  we  briefly  consider  the  effects  that  numerical  errors  due  to  finite ^precision  calcula¬ 
tions  have  on  the  performance  of  the  new  implementation  of  the  filtered-X  LMS  algorithm.  On 
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important  feature  of  the  LMS  algorithm  in  adaptive  filtering  is  its  robust  behavior  in  the  presence 
of  various  approximations  and  errors  that  are  often  introduced  in  a  real-world  implementation.  The 
original  implementation  of  the  filtered-X  LMS  algorithm  also  shares  similar  robustness  properties 
and  is  known  to  perform  adequately  despite  any  numerical  errors  introduced  within  the  controller 
calculations  and  any  delays  introduced  by  the  plant.  Moreover,  since  the  adjoint  LMS  algorithm 
[16]  is  one  form  of  a  filtered-error  LMS  algorithm  [15],  it  too  shares  many  of  the  robust  conver¬ 
gence  properties  of  other  stochastic  gradient  algorithms.  Since  the  the  new  implementation  of  the 
filtered-X  LMS  algorithm  applies  a  particular  form  of  delay  compensation  to  the  adjoint  LMS 
algorithm,  an  issue  remains  as  to  the  numerical  properties  of'-the  delay  compensation  technique, 
particularly  as  they  affect  the  long-term  performance  of  the  overall  system. 

While  an  analysis  of  the  numerical  properties  of  the  delay  compensation  technique  used  in  our 
new  algorithm  implementation  are  beyond  the  scope  of  this  paper,  it  appears  from  simulation  that 
the  compensation  method  does  not  significantly  alter  the  robust  numerical  properties  of  the  filtered— 
X  LMS  algorithm  in  this  implementation.  The  only  possible  source  of  numerical  difficulties  is  the 
method  for  calculating  rm(n )  in  (32),  as  this  update  is  marginally-stable  due  to  its  recursive  nature. 
Thus,  numerical  errors  in  rm(n )  can  grow  linearly  over  time  in  a  finite-precision  environment. 
Fortunately,  the  growth  in  these  errors  can  be  easily  prevented  using  several  well-known  procedures. 
Perhaps  the  simplest  procedure  is  to  periodically  recalculate  rm(n)  using  (32),  a  procedure  that 
requires  extra  additions  and  memory  locations  but  does  not  require  additional  multiplications. 
Another  solution  is  to  introduce  a  leakage  factor  into  the  calculation  of  rm(n).  One  particularly- 
useful  method,  described  in  the  single-channel  case  for  simplicity,  is  given  by 


rm(n) 


A rm(n  -  1)  +  x(n)x(n  -  m  -  1)  -  Az(n  -  L)x{n  -  L  -  m  -  1) 
rm(n  -  1)  +  x(n)x(n  -  m  -  1)  -  A x(n  -  L)x(n  -  L  -  m  -  1) 


if  nmodZ  = 
otherwise, 


where  A  is  slightly  less  than  one.  This  method  alters  the  value  of  rm(n)  slightly,  but  for  values  of 
A  close  to  one,  the  errors  introduced  into  the  calculations  for  y(n)  do  not  significantly  affect  the 
overall  behavior  of  the  control  system.  Moreover,  the  update  in  (34)  adds  little  complexity  to  the 
overall  system. 

Figure  2  plots  the  error  signal  (n)  of  three  different  four-input,  three-output,  four-error  active 
noise  control  systems  as  applied  to  air  conditioner  data  taken  in  an  anechoic  environment  [20].  In 
this  case,  all  calculations  were  performed  in  the  MATLAB  floating-point  environment.  Shown  for 
comparison  are  the  performances  of  the  original  filtered-X  LMS  algorithm,  the  new  filtered-X 
LMS  algorithm  of  Table  2,  and  the  new  filtered-X  LMS  algorithm  with  the  multichannel  version 
of  (34)  used  in  place  of  (32),  where  A  =  1  -  2"10,  fx(n)  =  0.5,  Z  =  500,  and  M  —  200.  As  can  be 
seen,  the  three  convergence  curves  are  indistinguishable  on  this  plot,  indicating  that  the  numerical 
stabilization  provided  by  (34)  does  not  significantly  alter  the  performance  of  the  overall  system. 


VIII.  CONCLUSIONS 


We  have  described  a  new  implementation  of  the  multichannel  filtered-X  LMS  algorithm  for  feed¬ 
forward  active  noise  and  vibration  control  tasks.  This  implementation  guarantees  the  same  input- 
output  behavior  of  the  original  implementation  while  requiring  only  a  fraction  of  the  computational 
effort-  and  memory  required  for  the  original  algorithm.  Because  of  the  pervasiveness  of  the  filtered- 
X  LMS  algorithm  in  active  noise  and  vibration  control  systems,  the  new  implementation  is  expected 
to  have  a  significant  impact  on  the  practicality  and  cost  of  these  schemes  in  real-world  applications. 
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Abstract-  The  sliding  discrete  Fourier  transform  (DFT)  is  an  important  tool  for  data 
analysis  and  adaptive  filtering  tasks,  as  is  the  simpler  task  of  calculating  the  sum  of 
L  signal  values  over  a  sliding  window.  While  such  systems  can  be  recursively  imple¬ 
mented,  numerical  errors  accumulate  in  the  resulting  outputs.  This  paper  presents 
a  periodically-time- varying  recursive  system  whose  output  at  every  ith  sample  time 
is  equivalent  to  that  of  the  sliding  DFT  and  whose  numerical  errors  do  not  grow 
with  time.  Moreover,  the  mathematical  difference  between  the  system’s  output  and 
that  of  the  non-recursive  DFT  can  be  made  arbitrarily  small  with  the  proper  choice 
of  the  leakage  parameter.  We  provide  a  statistical  analysis  of  the  numerical  per¬ 
formance  of  the  proposed  technique,  showing  that  it  outperforms  a  similar  approxi¬ 
mate  method  employing  an  exponentially-decaying  window.  When  applied  to  sliding- 
window-covariance  recursive  least-squares  adaptive  filters,  the  proposed  technique  mit¬ 
igates  this  system’s  error  accumulation  without  any  significant  increases  in  the  overall 
computational  complexity.  An  extension  of  the  method  to  the  sliding  discrete  cosine 
transform  (DCT)  is  also  provided. 
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1  Introduction 


Consider  the  following  discrete-time  linear  time- invariant  system: 

y(k)  =  £  e-»™ULx{k  _  m)f  (1) 

m=0 

where  l  is  an  integer  in  the  range  0  <  l  <  (L  -  1).  This  system  computes  the  /th  bin  value  of  the 
sliding  discrete  Fourier  transform  (DFT)  of  the  signal  x(k).  Such  a  system  is  useful  in  spectral 
estimation  [1]  as  well  as  in  transform-domain  adaptive  filtering  [2]. 

When  l  =  0,  (1)  computes  the  running  sample  average  of  a  signal  across  an  L-element  window. 
This  ubiquitous  system  is  useful  for  numerous  signal  processing  tasks.  In  particular,  it  appears 
in  certain  delay- compensation  techniques  that  are  useful  for  fast  affine  projection  (FAP)  adaptive 
filtering  [3,  4],  for  fast  exact  least-mean-square  (LMS)  adaptive  filters  [5],  for  pipelined  implemen¬ 
tations  of  the  LMS  adaptive  filter  (6,  7],  and  for  adaptive  feedfoward  control  schemes  in  active  noise 
control  [8,  9,  10].  In  addition,  if  x(k-  m)  represents  the  squared  estimation  error  of  an  iV-coefficient 
FIR  adaptive  filter,  than  y(k )  is  the  sum-of-squared-errors  across  a  sliding  data  window.  In  this 
case,  the  recursive  minimization  of  y(k )  over  time  yields  different  forms  of  the  sliding- window- 
covariance  recursive  least-squares  (SWC-RLS)  adaptive  filter  [11,  12].  Such  a  system  also  plays  an 
important  role  in  the  FAP  algorithm  [3,  4]. 

It  is  well-known  that  the  system  in  (1)  can  be  implemented  recursively  as 

y(k)  =  e-j2*I/Ly(k  -  1)  -  x{k  -  L)  +  x(k).  (2) 

Such  an  implementation  is  quite  useful,  as  it  only  requires  a  single  (complex)  multiply  and  two 
additions  per  time  instant.  However,  this  recursive  implementation  is  marginally-stable  due  to 
the  pole-zero  cancellation  that  occurs  at  2  =  e~j2irl^L  in  the  transfer  function  of  this  linear  time- 
invariant  system.  Thus,  finite-precision  errors  will  linearly  accumulate  in  the  value  of  y(k)  over 
time.  If  left  unchecked,  such  errors  can  make  (2)  useless  for  signal  processing  purposes.  For  this 
reason,  the  following  approximate  system  has  been  proposed  [2]: 

y{k)  =  g(A  e-MLrz(k-m),  (3) 

m= 0 

where  A  is  a  constant  that  is  slightly  less  than  one.  The  recursive  implementation  of  this  system  is 

y(k)  =  y(k  -  1)  -  \Lx{k  -  L)  +  x{k),  (4) 
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which  requires  two  multiplies  and  two  additions  per  time  instant.  While  this  system  is  numerically- 
stable,  it  no  longer  computes  the  exact  value  of  y(k)  in  (1),  although  the  difference  between  y(k) 
and  y(k)  can  be  made  small  via  suitable  choice  of  A.  An  alternative  solution  is  to  periodically 
restart  the  calculation  of  y(k).  This  method  does  not  require  any  additional  multiplies,  but  it 
does  require  more  additions  and  memory.  Moreover,  the  two-tiered  coding  strategy  needed  for  the 
implementation  of  the  system’s  restart  may  be  undesirable,  particularly  in  tasks  such  as  SWC-RLS 
adaptive  filtering  in  which  a  periodic  restart  can  incur  a  significant  computational  cost  [3]. 

When  implementing  the  sliding  DFT,  two  other  methods  are  of  particular  interest.  The  LMS 
spectrum  analyzer  uses  a  variant  of  the  LMS  algorithm  to  compute  an  L- point  sliding  DFT  [13]. 
While  its  complexity  is  similar  to  that  in  (2),  simulations  in  Section  4  show  that  it  suffers  from 
similar  numerical  accumulation  effects  when  implemented  in  a  floating-point  environment,  although 
its  numerical  properties  in  a  fixed-point  environment  appear  to  be  better  than  those  of  (2)  [14]. 
When  L  is  a  power  of  two,  the  sliding  FFT  is  a  non-recursive  method  for  computing  an  L- point 
sliding  DFT  that  requires  0(L )  multiplies  per  time  instant  to  implement  [15,  16].  This  system 
requires  0( L  log2  L)  memory  locations,  however,  which  can  be  prohibitive  for  some  applications. 

In  this  paper,  we  present  a  technique  that,  like  (4),  approximates  the  system  in  (1)  using  a 
simple  recursive  update.  Our  technique  is  a  periodically-time- varying  system  designed  so  that  any 
numerical  errors  that  are  introduced  by  finite-precision  arithmetic  at  any  time  instant  exponentially 
decay  to  zero  over  time.  Like  the  approximate  method  in  (4),  the  new  method  requires  two 
multiplications  and  two  additions  at  every  time  instant  and  is  simple  to  implement.  However,  unlike 
(4)  in  which  y{k)  ^  y(k )  in  general,  our  technique  produces  an  output  signal  that  is  mathematicafly- 
equivalent  to  y(k)  in  (1)  at  every  £th  time  instant.  At  other  time  instants,  the  difference  between 
the  output  of  the  proposed  system  and  in  (1)  can  be  made  arbitrarily  small  through  the  proper 
choice  of  the  leakage  parameter  A.  Moreover,  the  new  technique  does  not  duplicate  the  memory 
requirements  of  the  system,  as  does  a  periodic  restart. 

The  organization  of  this  paper  is  as  follows.  In  the  next  section,  we  introduce  the  proposed 
technique.  An  analysis  of  the  new  method’s  statistical  performance  when  l  =  0  is  given  in  Section  3, 
where  it  is  shown  that  its  average  bias  and  squared  error  are  lower  than  that  of  the  estimator  in  (4) 
for  equivalent  levels  of  numerical  precision  error.  In  Section  4,  applications  of  the  new  technique  to 
both  transform-domain  adaptive  filters  and  SWC-RLS  adaptive  filters  are  provided,  showing  that 
the  new  method  stabilizes  the  marginal  instabilities  in  these  systems  with  little  to  no  additional 
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computational  cost.  Section  5  provides  a  simple  extension  of  the  technique  to  the  sliding  discrete 
cosine  transform  (DCT).  Section  6  presents  our  conclusions. 

2  A  Numerically- Stable  Recursive  Sliding-Window  Estimator 


The  proposed  method  for  approximating  (1)  is  a  periodically-time-varying  linear  system.  If 
numerical  errors  are  not  present,  the  system  input-output  relation  is  equivalent  to  the  system 


L- 1 

y(k)  = 

hi(k ,  m)x(k  —  m) 

(5) 

771=0 

hi(k,m )  = 

(  e~i2irml/L  if  kmodL  >  m 
[  \e-i^m,lL  if  kmodL  <  m  ’ 

(6) 

where  x(k)  and  y(k)  are  the  input  and  output  signals  of  the  system,  respectively,  h\{k,  m)  is  the  time- 
varying  impulse  response  of  the  system  and  A  is  slightly  less  than  one.  Thus,  when  kmodL  =  L  —  1, 
the  value  of  y(k)  is  exactly  the  same  as  y(k)  in  (1).  At  other  sample  instants,  the  output  of  the 
system  in  (5)-(6)  deviates  from  that  in  (1).  A  simple  calculation  shows  that  the  magnitude  of  this 
deviation  is  no  greater  than 


\y(k)-y{k)\  <  (1  -  A)  £  \x(k  -  m)|, 

771  —  1 


(7) 


such  that  by  proper  selection  of  the  value  of  A,  the  mathematical  difference  between  these  two 
estimators  can  be  made  arbitrarily  small. 

The  system  in  (6)  has  a  simple  recursive  implementation  that  makes  it  a  useful  candidate  for 
approximating  the  sliding  DFT: 


f  \[e~^2'Kl/Ly(k)  —  x{k  —  £)]  +  x(k),  if  kmodL  =  0 
\  e~i2irl/Ly(k)  —  \x(k  —  L)  +  x(k),  otherwise. 


(8) 


This  implementation  requires  two  multiplications  and  two  additions  as  well  as  the  control  logic 
required  to  determine  when  kmodL  =  0.  Note  that  many  digital  signal  processors  (DSPs)  have 
built-in  circular  pointer  indexing  schemes  that  make  testing  for  the  condition  femodi  =  0  simple 
to  implement. 


3  Performance  Analysis 


We  now  analyze  the  performances  of  the  estimators  in  (4)  and  (8)  in  a  statistical  framework. 
For  simplicity,  we  consider  the  case  where  /  =  0  and  x(k )  is  real-valued,  such  that  the  outputs  of 
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Jr  X 


these  estimators  approximate  the  sum  of  the  L  most-recent  samples  of  x{k ).  In  these  analyses,  we 
assume  that  x(k)  is  a  stationary  uncorrelated  random  process  with  mean  fix  and  variance  In 
each  case,  we  determine  three  quantities: 

•  the  average  bias  in  the  outputs  of  each  system  with  respect  to  y(fc), 

•  the  variance  of  the  difference  between  the  outputs  of  each  system  and  y(k),  and 

•  the  variance  of  the  numerical  error  in  the  output  of  each  system  assuming  a  standard  statistical 
model  for  the  quantization  errors. 

3,1  Exponentially- Windowed  Estimator 

We  first  analyze  the  performance  of  the  system  in  (4)  under  the  above  assumptions.  These  results 
provide  a  baseline  with  which  the  performance  of  (8)  can  be  compared. 

The  average  bias  of  this  estimator  assuming  infinite  precision  calculations  is 


M  =  E{y(k )  -  y(k)} 

lm=0  J 


Under  our  statistical  assumptions,  this  expression  becomes 


L-l 


fi  =  =  l  - 1  — 


m= 1 


x-]y 

1  -  A  , 


The  variance  of  the  estimation  error  y(k)  —  y(k ),  denoted  as  <r2,  is  given  by 

a1  =  E  {[y(fc)  -  y(k)  -  £]2} 


=  E 


L-l 


-i  2 ' 


E  (!  -  \m){x(k  -  m)  -  fix) 

,m—0 


With  our  assumptions,  the  RHS  of  (13)  is 

m= 1 


2rr2 

ax 


(r  ,  nA-AL  A2  -  \2L' 
=  (1-1-2 - ^-  + 


(9) 

(10) 

(11) 


(12) 

(13) 


(14) 

(15) 


1  —  A  '  1-A2  , 

We  now  consider  the  performance  of  (4)  in  a  finite-precision  environment,  in  which  y(k),  the 
finite-precision  equivalent  of  y(k),  is  approximately 


y(k)  =  A y(k  -  1)  -  A Lx(k  -  L)  +  x(k)  +  et(k )  +  e0(k), 


(16) 
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where  e;(fc )  and  e0(k)  are  the  numerical  errors  associated  with  the  first  and  second  terms,  respec¬ 
tively,  on  the  RHS  of  (16).  Defining  e(k)  as 

e(k)  =  y(k)-y(k),  (17) 

we  can  develop  a  recursive  equation  for  e(k)  given  by 

e(k)  =  \e(k  -  1)  +  ei(k)  +  e0(k).  (18) 


Assuming  that  6{(k)  and  €0(k)  are  zero  mean,  independent,  and  identically-distributed  (i.i.d.)  with 
equal  variances  cr2,  we  obtain  the  limiting  variance  of  e(k)  as 

2<t2 

Hm  oj(fc)  =  (19) 

k—<x>  1  -  A2 

3.2  Periodically  Time- Varying  Estimator 


We  now  analyze  the  statistical  performance  of  (8)  under  our  assumptions.  Since  the  system  has 
a  time-varying  impulse  response,  we  consider  quantities  that  are  averaged  over  L  sample  times  in 
order  to  provide  a  fair  comparison  with  our  previously-derived  results. 

We  first  consider  the  time-averaged  bias,  denoted  as 

=  7  Y  E{y(n)-y(n)} 


n—k—L- i-1 


=  J  Y  -  h0(n,m))x(n-  m)| . 

^  n-k  —  L-rl  1 7n=0  J 


(20) 

(21) 


Employing  the  expression  for  ho(k,  m)  in  (6)  we  can  simply  the  above  expression  as 

F  =  2  Y  Y  (1  -X)E{x(n-m)} 

n=fc— L+l  m=nmodL 
L— 1 


=  y  — (1  -  A)/i*. 


(22) 

(23) 


m=l 


The  time-averaged  error  variance  of  the  new  estimator’s  output,  denoted  as  cr2,  is  defined  as 
o2  =  y  Y  E^y(n)  -  y{n )  -  £]2} 


n—k-L-^l 

i  i  4 

n=k-L+ 1  1 


rL-i 


£(1- h0(n,m))(a:(re-  m)  -  /zx) 


,m=0 


(24) 

(25) 
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Using  simplifications  that  are  similar  to  those  used  in  (22)-(23),  the  right-hand-side  of  (25)  is 


^  =  jt,  (2«) 

m= 1  ~ 

Finally,  we  consider  the  accumulation  of  errors  in  y{k)  in  a  finite-precision  environment.  The 
numerical  model  in  this  case  is  similar  to  that  in  (16)  and  is  given  by 

-(u\  _  /  Z  x(k  ~  ^)]  +  x(k)  +  e°(k)  +  ei(k)’  kmodL  =  0  ,  . 

-  |  y(k)  —  \x{k  —  L)  +  z(fc)  +  €i(k),  otherwise. 

For  simplicity,  we  only  consider  the  worst-case  performance  by  determining  the  level  of  numerical 
errors  in  y{k )  at  time  instants  k  =  nL-1,  where  the  value  of  ~y(k)  equals  y(k)  in  an  infinite-precision 
environment.  By  defining  e(nL  —  1)  =  y(nL  —  1)  —  y(nL  —  1),  it  is  straightforward  to  show  that 


e(nL  -  1)  =  Xe((n  -  1  )L  -  1)  +  e0((n  -  1  )L)  +  ex(nL  -  m). 


Thus,  the  limiting  value  of  the  variance  of  e(nL  —  1)  is 


lim  <r|(raX  -  1) 


(L  +  IK2 

1  -  A2 


3.3  Performance  Comparison 


We  now  compare  the  performances  of  the  recursive  estimators  in  (4)  and  (8).  For  this  comparison, 
we  equate  the  numerical  precision  error  variances  as  expressed  by  (19)  and  (29),  respectively,  and 
solve  for  A  for  the  exponentially-windowed  estimator  in  terms  of  A  for  the  new  estimator.  This 
operation  yields  the  relationship 


Then,  we  compute  the  average  biases  and  error  variances  for  each  algorithm  using  their  respective 
parameter  values  A  and  A. 

Table  1  shows  the  values  of  the  biases  /2  and  JI  as  well  as  the  error  variances  a2  and  cf2, 
normalized  by  L/j,x  and  Xcr2,  respectively.  In  each  case,  it  is  observed  that  the  proposed  scheme 
has  less  bias  and  less  error  variance  than  the  exponentially- windowed  scheme.  Thus,  the  proposed 
scheme  is  to  be  preferred  over  the  existing  stabilization  technique  from  the  standpoint  of  numerical 
performance.  In  addition,  we  have  simulated  the  behaviors  of  both  algorithms  in  the  MATLAB 
data  analysis  environment,  where  sequences  of  zero  mean  uncorrelated  Gaussian  random  variables 
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of  unit  variance  were  used  to  estimate  each  of  the  quantities  in  the  table.  In  each  case,  the  estimates 
matched  the  calculated  values  for  the  chosen  X,  A,  and  A  to  within  a  small  error  tolerance,  indicating 
that  our  calculations  are  accurate. 


4  Simulations 

In  this  section,  we  compare  the  numerical  performances  of  (8)  with  other  proposed  recursive 
methods.  We  also  apply  the  method  to  the  task  of  0(N 2)  SWC-RLS  adaptive  filtering  and  compare 
its  numerical  performance  with  an  existing  0(N 2)  method.  In  all  cases,  the  algorithms  have  been 
implemented  in  the  MATLAB  signal  manipulation  environment.  In  addition,  the  MATLAB  com¬ 
mands  randnO  and  filter ()  have  been  used  to  generate  zero-mean  Gaussian  random  sequences 
with  specific  correlation  statistics  as  test  signals  for  the  algorithms,  and  in  the  case  of  the  sliding 
DFT  methods,  we  have  employed  MATLAB’s  fft()  routine  to  generate  baseline  quantities  for 
numerical  comparisons. 

4.1  Sliding  DFT 

In  this  section,  we  explore  the  numerical  performance  of  the  sliding  DFT  in  (2),  the  proposed 
sliding  DFT  in  (8),  and  the  LMS  spectrum  analyzer  in  [13],  via  simulations.  In  each  case,  we  have 
computed  the  L  =  16-point  sliding  DFT  of  a  sequence  of  unit-variance  Gaussian  random  variables 
using  each  method,  and  we  then  calculate  the  total  squared  numerical  error  between  the  resulting  16 
signals  and  those  obtained  from  a  non-recursive  FFT  implementation  at  each  time  instant.  For  the 
proposed  method,  we  have  chosen  A  =  0.999.  Figure  1  shows  the  total  squared  numerical  errors  for 
the  three  methods  as  a  function  of  time,  where  we  have  only  plotted  the  errors  when  kmodL  =  L- 1 
such  that  all  of  the  methods  would  compute  the  exact  DFT  in  an  infinite-precision  environment. 
As  can  be  seen,  the  numerical  errors  of  both  the  standard  sliding  DFT  and  LMS  spectrum  analyzer 
grow  linearly  over  time,  whereas  that  of  the  proposed  technique  does  not  exhibit  such  growth.  This 
result  indicates  that  the  proposed  technique  mitigates  numerical  growth  of  errors,  unlike  the  other 
recursive  methods. 

We  now  apply  the  proposed  technique  to  transform- domain  adaptive  filtering,  in  which  one 
wishes  to  estimate  a  component  of  a  desired  signal  d(k )  using  the  output  d(k )  of  an  adaptive  FIR 
filter  with  N  adjustable  parameters  in  the  vector  W (k)  =  [w0(k)  ■  •  ■  Wj\_i(k)]T .  The  output  of 
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the  filter  is  computed  as 


N 

d(k )  =  J2wi(kXk)  =  wt(£)u(ao,  (31) 

i=0 

where  U(fc)  =  [uo(^)  •  •  •  u/v_i (k)]T  is  a  linearly-transformed  version  of  the  measured  input  signal 
vector  X(&)  =  [ x(k )  •  •  •  x(k  -  N  +  1)]T.  The  goal  of  the  adaptive  filtering  task  is  to  adjust  W(k) 
such  that  the  mean-squared  error 

E{\e(k)\2}  =  E{\d(k)-WT(k)V(k)\2}  (32) 

is  minimized  over  time.  One  algorithm  for  adjusting  W (k)  is  the  transform-domain  least-mean- 
square  (LMS)  algorithm  given  by 

W(Jfe+l)  =  W(jfc)  +  M(Jb)c(jfe)U*(ife),  (33) 

where  M (k)  is  a  diagonal  matrix  of  positive  step  size  parameters  and  *  denotes  complex-conjugate. 
Typically,  the  (i,  i)th  value  of  M (k)  is  a  scaled  inverse  of  the  time-averaged  value  of  |^+i(fc)|2,  as 
this  choice  causes  the  matrix  U{M(k)U*(k)UT(k )}  that  governs  the  average  adaptation  behav¬ 
iors  of  the  coefficients  to  have  a  smaller  eigenvalue  spread  and  enables  faster  convergence  of  the 
coefficients  to  their  optimum  values  [17,  18,  19]. 

Figure  2(a)  and  (b)  shows  the  error  signals  e[k)  and  e(k)  of  two  different  implementations  of 
the  adaptive  filter  in  (33)  as  applied  to  an  N  —  L  —  8-coefficient  linear  prediction  task  in  which 
d(k)  =  x(k  +  1)  and  x(k)  is  created  by  filtering  a  zero-mean  Gaussian  random  sequence  s(k)  as 

x(k)  =  «(A?)  +  0.73(A;  —  1)  +  1.2«(fc  —  2)  +  —  3).  (34) 

Shown  for  comparison  are  the  errors  from  the  systems  in  which  the  elements  of  U(&)  are  computed 
non-recursively  and  recursively  via  (8)  with  A  =  0.999,  respectively.  Each  of  the  diagonal  elements 
of  M (k)  for  both  algorithms  are  computed  by  filtering  the  squared  value  of  each  element  of  U (k) 
with  a  lowpass  filter  with  transfer  function  1/(1  —  0.992T1)  before  inverting  the  resulting  value.  The 
two  plots  are  nearly-indistinguishable  from  each  other,  and  Figure  2(c)  shows  the  difference  signal 
e(k)  —  e(fc),  in  which  the  magnitude  of  the  difference  is  less  than  0.1%  over  the  entire  adaptation 
period.  Thus,  the  approximate  sliding  DFT  method  in  (8)  does  not  significantly  alter  the  behavior 
of  the  overall  system. 
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4.2  Recursive  Least-Squares  Adaptive  Filtering 

In  sliding-window-covariance  RLS  adaptive  filters,  one  minimizes  the  error  criterion 

L—l 

J{W{k))  =  £  [d(k  -  m)  -  W T{k)X(k  -  m)]2,  (35) 

m=0 

where  d(&),  X(&),  and  W(k)  have  been  defined  previously.  By  differentiating  this  cost  function 
with  respect  to  the  filter  coefficient  vector  W (k)  and  setting  the  result  to  the  zero  vector,  we  obtain 
the  well-known  solution 


W(Jfc)  =  R-^JfeJP  (fc), 


(36) 


where 


L- 1 

R (k)  =  ^2  X(&  -  m)XT(k  -  m) 

(37) 

m— 0 

L-l 

P (k)  =  J2  d(k  ~  m)X(£  -  m )■ 

771=0 

(38) 

Comparing  R(fc)  and  P (k)  with  y(k )  in  (1),  it  is  clear  that  we  can  recursively  compute  them  as 

R(Jfc)  =  R(A:-l)-X(fc-Z)XT(/fc-I)  +  X(£:)Xr(fc)  (39) 

P(Jfc)  =  P(lb  -  1)  -  d(k  -  L)X(k  -  L)  +  d(k)X(k),  (40) 


in  analogy  with  (2).  Such  a  computational  method  is  marginally-stable,  however,  and  therefore, 
any  implementation  that  explicitly  or  implicitly  employs  the  update  relationships  in  (39)-(40) 
experiences  numerical  error  accumulation  in  a  finite-precision  environment. 

Given  our  previous  results,  it  is  natural  to  consider  a  modified  least-squares  cost  function  of  the 
form 


L-l  _ 

J(W{k))  =  rn)[d{k  -  m)  -  W  (k)X(k  -  m)]2,  (41) 

m~  0 

where  ho(k,m )  is  as  defined  in  (6).  A  similar  derivation  to  the  one  that  produces  (36)-(40)  can  be 
performed  for  J(W(k)),  and  the  solution  obtained  is  identical  to  (36)  except  that  the  corresponding 
R(&)  and  P (k)  are  identical  in  form  to  y(k)  in  (5).  Thus,  in  analogy  with  (8),  we  can  compute 
R (k)  recursively  as 


R(ib) 


A[R (k)  -  X(k  -  L)XT(k  -  L )]  +  X(k)XT(k),  if  kmodL  =  0 
R(jfc)  -  A X(Jfe  -  L)XT{k  -  L)  +  X(k)XT(k),  otherwise, 


(42) 
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and  P (k)  has  a  similar  update.  The  resulting  recursive  solution  for  W(k)  is  numerically-stable, 
because  the  estimators  for  R (k)  and  P(&)  are  numerically-stable.  Moreover,  because  J{ W(fc))  is 
identical  to  J(W(k))  for  k  =  nL  —  1,  we  have  that 

W(nX-l)  =  W(nX-l),  (43) 

in  the  absence  of  any  numerical  errors. 

By  applying  the  matrix  inversion  lemma  [20]  twice  to  the  right-hand-side  of  (42),  one  can 
propagate  the  value  of  R-1(&)  directly  from  K~l(k  -  1),  X(k),  and  X(fc  -  L).  Then,  by  combining 
the  updates  with  those  for  P (k),  one  obtains  a  set  of  direct  updates  for  W(k).  Table  2  lists  the 
equations  for  this  numerically-stable  version  of  the  0(N2)  SWC-RLS  algorithm,  where  W (k)  = 
W L(k).  Note  that  the  complexity  of  this  algorithm  is  identical  to  that  of  the  original  sliding- 
window-covariance  RLS  algorithm  (A  =  1)  when  kmodL  ^  0,  and  thus  for  large  values  of  L  relative 
to  the  filter  length  N,  the  complexity  of  the  proposed  algorithm  is  similar  to  that  of  the  original 
algorithm. 

We  have  simulated  the  performance  of  both  the  original  and  proposed  0(N2)  SWC-RLS  algo¬ 
rithms  in  the  linear  prediction  task  described  previously,  where  L  —  16  and  N  =  8.  Figure  3  shows 
the  total  coefficient  error  powers  ||W(fc)  -  Wopt(&)||2  and  ||W(&)  -  Wop<(A;)||2  for  the  original 
and  proposed  0(N 2)  SWC-RLS  algorithms,  respectively,  where  Wppt(A;)  =  R-1(fc)P(&)  is  the  non- 
recursive  0(N3)  least-squares  solution  at  time  k  and  A  =  0.995  for  the  proposed  algorithm.  Here, 
we  have  plotted  a  smoothed  version  of  the  numerical  errors  at  time  instants  where  kmodL  =  L  —  1. 
As  can  be  seen,  the  original  algorithm  experiences  numerical  error  accumulation  over  time,  unlike 
the  proposed  method  which  remains  numerically-stable. 

5  Extensions 

5.1  A  Numerically-Stable  Sliding  DCT 

While  useful,  the  proposed  technique  for  computing  the  sliding  DFT  in  (8)  employs  complex- valued 
arithmetic,  a  feature  that  is  undesirable  in  applications  where  x(k )  is  real-valued.  In  such  cases, 
a  real-valued  transform  such  as  the  discrete  cosine  transform  (DCT)  is  more-useful.  In  addition, 
a  recent  analysis  of  the  DFT  and  DCT  in  transform- domain  adaptive  filtering  indicates  that  the 
DCT  provides  better  orthogonalizing  properties  for  certain  input  signals  [19].  In  this  section,  we 
provide  a  numerically-stable  periodically- time- varying  system  that  approximates  the  sliding  DCT, 
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thus  extending  the  method  in  (8)  to  linear  systems  that  employ  two  marginally- stable  complex- 
conjugate  pole-zero  cancellations. 

A  recursive  method  for  computing  the  Ith  bin  value  of  the  sliding  DCT  for  1  <  /  <  L  -  1  is  [17] 


ui{k) 

=  7iy(k) 

(44) 

y(k) 

=  2  cos(hr / L)y(k  —  1)  —  y(k  -  2)  +  x(k) 

-  x(k  -  1)  -  (-iy[y(&  -  L)  -  y(k  -  L  -  1)], 

(45) 

where  7/  =  i/2/icos(/ff/(2i)).  The  computation  of  the  zeroth  sliding  DCT  bin  value  is  the  same 

as  that  for  the  sliding  DFT  in  (2),  except  for  a  scale  factor  of  70  =  Ijs/L. 

The  corresponding  periodically-time-varying  system  that  implements  the  sliding  DCT  in  a 

numerically-stable  fashion  replaces  y(k)  in  (44)  by 

r  A[2  cos(lir  /  L)y(k  —  1)  —  y(k  —  2)]  +  x(k ) 

-x(k  -  1)  -  A(-l  )l[x{k  -L)-x(k-L-  1)]  ’ 

...  _  2  cos(ln/L)y(k  —  1)  —  \y(k  -  2)  -I-  x(k) 

y[k>  ~  ]  —x(k  —  1)  —  A(— !.)*[*(&  —  L)  —  x(k  -  Z  —  1)]  ’ 

2  cos(/7r / L)y{k  -  1)  -  y(k  -  2)  +  x{k) 

,  -x{k  -  1)  -  A(-l  )l[x(k-  L )  -  x{k  -L-  1)]  ’ 

In  this  case,  a  second-order  recursive  system  is  employed,  and  the  stabilizing  factor  A  is  applied  to 
the  recursive  terms  within  the  updates  in  different  ways  for  two  out  of  every  L  iterations  of  the 
system. 

Figure  4  shows  the  total  squared  errors  between  the  L  =  16-point  sliding  DCT  and  the  non¬ 
recursive  DCT  for  both  methods  in  (45)  and  (46),  respectively,  for  A  =  0.999.  As  in  the  previous 
cases,  only  the  values  at  kmodL  =  L  —  l  are  shown.  We  see  that  the  growth  in  numerical  errors 
for  the  original  recursive  implementation  is  mitigated  by  the  proposed  technique. 

5.2  Arbitrary  Duty  Cycles 

Because  the  proposed  methods  produce  exactly  the  same  results  at  time  &mod£  -  L  —  1  as  the 
original  non-recursive  methods  in  infinite-precision  arithmetic,  then  we  can  easily  extend  the  interval 
over  which  the  value  of  y{k)  matches  that  of  y(k)  for  each  system  in  a  simple  fashion.  For  the  DFT 
and  DCT  methods  in  (8)  and  (46),  respectively,  we  replace  the  test  kmodL  =  0  with  the  test 
kmodM  =  0,  where  M  is  any  integer  greater  than  L.  Then,  over  the  interval  L  <  kmodM  <  M, 
we  use  the  marginally-stable  recursive  updates  (2)  and  (45)  to  compute  the  outputs  of  each  system, 
respectively.  In  this  way,  the  value  of  y(k)  is  mathematically-identical  to  the  sliding  DFT  and  DCT 


if  kmodL  =  0 

if  kmodL  =  1  (46) 

otherwise. 
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over  the  periods  defined  by  L  -  1  <  kmodM  <  M.  A  similar  approach  can  be  applied  to  the 
SWC-RLS  algorithm  in  Table  2. 

While  potentially-useful,  this  extension  reduces  the  effective  number  of  stabilizing  updates  by 
the  factor  L  /M  over  the  original  method,  and  thus  one  can  expect  that  the  levels  of  numerical 
error  in  the  outputs  will  increase  by  a  factor  of  approximately  Mj L.  Thus,  a  smaller  value  of  A  is 
necessary  to  obtain  the  same  numerical  performance  as  that  of  the  original  method,  which  causes 
a  larger  deviation  between  y(k)  and  y(k)  during  the  period  0  <  kmodM  <  L  -  1. 

6  Conclusions 

In  this  paper,  we  have  presented  recursive  systems  that  implement  the  sliding  DFT  and  DCT 
in  a  nnmerira.lly-sta.hle  fashion.  These  algorithms  employ  periodically-time-varying  linear  systems 
that  mitigate  the  growth  in  numerical  errors  when  implemented  in  finite-precision  arithmetic  while 
exactly  computing  the  desired  quantities  over  a  portion  of  the  input  sequence.  Moreover,  we  have 
applied  this  technique  to  the  0(N 2)  sliding-window-covariance  RLS  adaptive  filter,  showing  that 
the  linear  accumulation  of  numerical  errors  of  the  original  system  does  not  occur  in  the  proposed 
system.  These  methods  are  expected  to  have  wide  use  in  a  number  of  practical  signal  processing 
systems  and  in  the  implementation  of  adaptive  filtering  algorithms  in  particular. 

While  the  techniques  proposed  in  this  paper  are  useful,  a  general  method  for  deriving  a  periodi¬ 
cally-time-varying  system  that  exactly  implements  any  particular  marginally-stable  time-invariant 
system  has  not  been  provided.  Such  a  method  would  be  useful,  although  the  resulting  systems 
may  be  quite  complicated  to  implement  in  the  most-general  cases.  In  this  regard,  the  techniques 
provided  in  this  paper  provide  simple,  effective  solutions  for  several  systems  that  are  already  in  use 
in  real-world  situations. 
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Table  1:  Comparison  of  numerical  performance,  exponentially- windowed  and  proposed  schemes, 


l  =  0. 
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Table  2:  The  Q(iV2)  stabilized  SWC-FTF  algorithm. 
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Equation 

if  kmodL  =  0 

1(a) 

crn  _  RZ1^-!)^) 

1  ’  X  +  XT{k)R21(k-l)X(k) 

2(a) 

R-Zii  W  =  ^ 1  (Rl\k  ~  1)  -  C(k)XT(k)Rll(k  -  1)) 

else 

1(b) 

cm  _  Ri'(*-W*> 

V  ’  l+XT(l;)RZ1(^-l)X(/fc) 

2(b) 

RZliW  =  Rll{k-i)-c{k)xT{k)R-L\k-i) 

end 

3 

e{k)  =  d{k)  -  XT(k)WL(k  -  1) 

4 

W  i+1(Jfe)  =  WL{k-l)  +  e(k)C(k) 

5 

D(k)  =  Rll+1(k)X(k  -  L) 

6 

j(k)  =  (^-Tl  +  XT{k-L)R(k)y1 

7 

R 2\k)  =  Rll^-Di^ik^ik) 

8 

u(k)  =  d(k  -  L)  -  XT (k  -  L)W L+1(k) 

9 

W  L(k)  =  WL+1(k)  +  j(k)u(k)B(k) 

16 


Figure  1:  Total  squared  numerical  errors:  original  sliding  DFT,  proposed  sliding  DFT,  and  the 
LMS  spectrum  analyzer,  uncorrelated  Gaussian  input  signals,  X  =  16,  A  =  0.999. 


Total  Squared  Numerical  Parameter  Error 


Figure  3:  Total  squared  numerical  errors  in  estimated  coefficients:  standard  and  proposed  0(N 2) 
SWC-RLS  adaptive  filters,  L  =  16,  N  =  8,  A  =  0.995. 
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An  Efficient  Implementation  of  the 
Modified  Filtered-X  LMS  Algorithm 

Scott  C.  Douglas,  Member ,  IEEE 


Abstract — The  iiltered-X  LMS  algorithm  used  in  active  noise 
control  applications  suffers  from  slow  convergence  due  in  part 
to  the  output  delay  caused  by  the  secondary  path  of  the  system. 
In  this  letter,  we  provide  a  computationally  efficient  method  for 
removing  this  output  delay  within  the  error  signal  used  to  update 
the  controller  coefficients,  such  that  the  standard  LMS  algorithm 
is  effectively  employed. 

Index  Terms —  Acoustic  signal  processing,  adaptive  control, 
adaptive  filters,  adaptive  signal  processing,  least  mean  square 
methods. 

I.  Summary 

THE  filtered-X  least-mean-square  (LMS)  algorithm  is  a 
useful  method  for  adapting  the  coefficients  of  a  finite  im¬ 
pulse  response  (FIR)  filter  for  active  noise  control  applications 
[1],  The  coefficient  updates  for  this  algorithm  are  given  by 

W L(n  +  1)  =  W L{n)  -  M(n)€(n)FL(n)  (1) 

where  W £,(n)  =  [wo (n)  •  *  •  (n)]T  [S  the  coefficient  vec¬ 

tor  of  the  adaptive  filter  at  time  n,  F ^(n)  =  [/(n)  *  *  •  f(n  - 
L  4-  1)]T  contains  the  L  most-recent  samples  of  the  filtered 
input  signal,  e(n)  is  the  error  sensor  signal  at  time  n,  and  /x(n) 
is  the  step  size  at  time  n.  In  this  case,  f(n)  is  computed  as 

/(n)  =  H&Xw(n  -  1)  (2) 

where  Hm[Ai  •  *  *  /uw]T  contains  the  secondary  path  impulse 
response  and  Xa*  (n)  =  [a;(n)  *  *  *  x(n  —  M  4-  1)]T  contains 
the  M  most  recent  samples  of  the  input  signal.  The  output  of 
the  controller  is  computed  as 

y(n)  =  Xl(n)W  L(n)  (3) 

where  X^(n)  =  [: x(n )  ■  ■  ■  x(n— L+1)]T  contains  the  L  most- 
recent  samples  of  the  input  signal.  The  error  sensor  signal  e(n) 
is  the  sum  of  the  primary  signal  d(n)  to  be  cancelled  and  a 
filtered  version  of  the  controller  output,  given  by 

c(n)  =  d(n)  +  HjfYjM(n-l)  (4) 
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where  Y,v/(n)  =  [y(n)  *  •  •  y(n  —  M  -f  1)]T  and  where  we 
have  assumed  that  the  FIR  filter  H,v/  accurately  represents 
the  secondary  path  transfer  characteristics.  Since  (4)  is  not 
explicitly  calculated  within  the  controller,  the  filtered-X  LMS 
adaptive  filter  requires  2 L  +  M  +  1  multiply/accumulates 
(MAC’s)  per  iteration,  and  it  uses  3 L  4-  M  4-  2  memory 
locations. 

By  substituting  (3)  into  (4),  we  see  that  the  error  sensor 
signal  is  effectively  computed  using  past  coefficient  vec¬ 
tors  {Wl(ti  -  1),  W L,(n  -  M)}.  The  resulting  delay 

within  the  coefficient  updates  leads  to  slower  convergence,  a 
restricted  step  size  range  for  stability,  and  overall  reduced  per¬ 
formance  [2].  A  method  is  presented  in  [3]— [5]  to  effectively 
remove  this  delay  within  the  coefficient  updates,  such  that  the 
behavior  of  the  system  is  similar  to  that  of  a  standard  LMS 
adaptive  filter  with  input  signal  f(n)  and  desired  response 
signal  d(n).  The  coefficient  vector  update  for  this  modified 
filtered-X  LMS  algorithm  is 

W L(n  +  1)  =  W L(n)  -  fjb(n)e(n)¥ i(n)  (5) 

e(n)  =  e(n)  -  H&YjW(n  -  1)  +  F£(n)WL(n).  (6) 

In  this  algorithm,  it  is  assumed  that  H m  in  (6)  accurately 
represents  the  secondary  path  impulse  response  so  that  the 
computed  value  of  e(n)-H^Y;v/(n-‘l)  accurately  represents 
the  primary  disturbance  d(n)  to  be  cancelled.  This  algorithm 
requires  3 L  +  2 M  4- 1  MAC’S  per  iteration  and  3 L  -f  2 M  +  3 
memory  locations  to  implement  as  described. 

For  long  filter  lengths  L  relative  to  the  secondary  path 
impulse  response  length  M,  the  additional  complexity  of  the 
modified  filtered-X  LMS  algorithm  over  that  of  the  filtered- 
X  LMS  algorithm  is  prohibitive  in  some  cases.  Approximate 
implementations  of  the  above  algorithm  have  been  developed 
that  use  approximately  2 L  +  2 M  MAC’s  per  iteration  [6]; 
however,  the  performance  of  these  algorithms  only  approaches 
that  of  the  above  algorithm  in  certain  cases.  An  alternate, 
exact  implementation  of  the  algorithm  in  (5)  and  (6)  is 
described  in  [7];  however,  this  implementation  requires  about 
2L  +  Q.5M2  +2.5M  MAC’s  per  iteration,  which  for  large  M 
is  computationally  prohibitive. 

In  this  paper,  we  derive  a  novel  exact  implementation  of 
the  algorithm  in  (5)  and  (6).  Our  equivalent  implementation 
requires  only  2 L  +  5 M  4-  1  MAC’s  per  iteration  and  3 L  4- 
4 M  4-  3  memory  locations  to  implement.  Thus,  if  L  >  3 M, 
our  implementation  is  more  computationally  efficient  than  the 
original  implementation,  and  for  M  >  5,  our  implementation 
is  more  computationally  efficient  than  that  presented  in  [7]. 
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TABLE  I 

Fast  Modified  Filtered-X  LMS  Algorithm 


# 

Equation 

#  MAC'S 

1 

«<">(»)  =  ,i (»){«(»)  +  H^U M(n  -  1)} 

M  +  l 

2 

/(«)  =  H jCfXM(«  -  1) 

M 

3 

y(n)  =  Xl(n)WL(n) 

L 

4 

F'»= 

0 

5 

RM(n)  = %(»  -  1)  +  X,v/ («)/(”)  -  Xm(u  -  L)f(n  -  L) 

2M 

6 

U,w(»)  =  Um_1°(b  _  !)]  —  Rw(»)«°‘>(n) 

M 

7 

W r.(n  +  1)  =  Wt(n)  -  rt(")(„)pt(n) 

L 

Total: 

■2L  +  5M  +  1 

II.  Algorithm  Derivation 

The  algorithm  we  derive  is  a  nontrivial  modification  of 
a  method  presented  in  [8]  to  remove  the  adaptation  delay 
within  the  delayed  LMS  algorithm.  For  this  derivation,  we  note 
that  the  additional  complexity  of  the  modified  filtered-X  LMS 
algorithm  over  that  of  the  filtered-X  LMS  algorithm  stems 
from  the  error  recalculation  in  (6).  By  defining  the  matrix 

X(n)  =  [XL{n)  •  •  •  XL(n  -  M  +  1)]  (7) 

=  [XM(n)  +  (8) 


-  uM_l(„-i)]-xT<n)r‘(",e“,,(n)  <14) 

e^\n)  =/x(n)e(n)  (15) 

where  Uiv/_i(n)  contains  the  first  M  —  1  elements  of  Um(ti) 
and  we  have  substituted  the  update  relationship  for  W l{u)  in 
(5)  into  the  second  term  of  (13).  Define  the  M-dimensional 
vector  R,v/(n)  as 

RM(n)=Xr(n)FL(n).  (16) 


we  can  express  e(n)  as 


Then,  it  can  be  shown  that  Rm(ti)  can  be  updated  as 


e(n)  ==  e(n)  -  H^Yj\f(n  -  1)  H-  H^XT(n  -  I)Wl(ti) 

(9) 

=  c(n)+H^UM(n-l)  (10) 

with  the  M-dimensional  vector  Vm(u)  defined  as 

U a#(ti)  =  XT{n)WL(n  +  1)  -  YM(n).  (1 1) 

To  efficiently  compute  the  vector  UjV/(n),  we  see  that 

U  M{n)  = 

Xl(n){Wi(n  +  l)-WL(n)}  1 

X£ (n  -  1){W L(n  +  1)  -  WL(n  -  1)} 

l(n  -  M  +  1){W L(n  + 1)  -  W L{n  -  M  +  1)}. 

(12) 

We  can  write  U,y/(n)  as 

0 

XX(n-l){Wt(n)-WL(n-l)} 

U;V/(n)  = 

X£(n  -M  +  l){Wi(n)  -  W  L{n  -M  +  1)}. 

Xl(n){WL(n  +  l)-WL(n)}  1 

Xl(n  -  l){Wi(n  +  1)  -  WL(n)} 

Xl(n  -M  +  1){Wl(ti  +  1)  -  Wi(n)}. 

(13) 


R,v/(n)  =  R M(n  - 1  )+XM(.n)f{n)  -  XM(n  -  L)f(n  -  L). 

(17) 

Combining  (2),  (3),  (5),  (10),  (14),  (15),  and  (17)  gives  the 
fast  implementation  of  the  modified  filtered-X  LMS  algorithm. 
Table  I  lists  the  complete  algorithm  and  the  number  of 
multiplies  required  for  each  step,  where  Fl-i(ti)  contains  the 
L  — 1  most  recent  samples  of  the  filtered  input  signal  f(n).  The 
overall  complexity  of  this  new  implementation  is  less  than  that 
of  the  original  implementation  if  L  >  3 M.  Such  a  situation 
is  reasonable  in  broadband  active  noise  control  applications 
when  the  secondary  source  is  located  near  the  error  sensor 
and  both  the  secondary  source  and  error  sensor  are  far  away 
from  the  input  sensor. 

III.  Conclusion 

In  this  letter,  we  have  shown  how  the  modified  filtered- 
X  LMS  algorithm  can  be  implemented  efficiently,  so  that 
standard  delayless  LMS  adaptation  can  be  employed  in  active 
noise  control  applications.  The  modification  described  here  can 
also  be  applied  to  other  useful  algorithms  for  active  noise 
control,  such  as  those  employing  sgn  (-)-type  error  and  data 
non  linearities  [9]. 
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I.  INTRODUCTION 

In  single-channel  feedforward  active  noise  control,  an  input  signal  *(/*)  is  measured  and  processed 
by  a  time-varying  finite-impulse-response  (FIR)  filter  as 


L- 1 

if(»)  =  Y  Mn)x(n  ~ l)  =  XT(n)W(n),  (1) 

1=0 

where  the  vector  X(n)  =  [x(n)  •  •  •  x(n  -  L  +  1)]T  contains  the  L  most-recent  samples  of  the  input 
signal  and  W(n)  =  [• wo(n )  •  •  •  ttf£,_i(n)]T  is  the  coefficient  vector  of  the  controller  at  time  n.  The 
output  of  the  controller  propagates  to  the  desired  quiet  region,  where  it  combines  with  the  primary 
signal  to  be  cancelled,  denoted  by  d(n).  An  error  sensor  measures  the  linear  combination  of  these 
two  signals  as  modeled  by  the  equation 

e(n)  =  d(n)+HrY(n-l),  (2) 

where  e(n)  is  the  measured  error  signal,  Y (re  -  1)  =  [y(n  -  1)  •  •  •  y(n  -  M)]J,  and  where  the 
FIR  filter  H  =  [/jj  ■  •  •  HmY  is  assumed  to  accurately  represent  the  transfer  characteristics  of  the 
output-actuator-to-error-sensor  secondary  path.  The  task  is  to  adjust  or  adapt  W(n)  so  that  the 
magnitude  of  e(n)  is  reduced  over  time. 

Various  algorithms  for  adjusting  W(n)  have  been  proposed  [1,  2,  3,  4].  For  the  most  part, 
they  involve  multiply  and  add  operations  that  are  similar  to  the  FIR  filter  output  calculation,  and 
they  typically  employ  an  estimate  of  the  secondary  path  impulse  response  H.  To  obtain  higher 
cancellation  performance  in  broadband  noise  control  applications,  it  is  desirable  to  increase  the 
lengths  of  W (n)  and  H  so  that  the  controller  can  more  accurately  represent  the  physical  paths 
within  the  system.  This  change  increases  the  number  of  computations  to  be  performed  by  the 
controller  at  each  time  instant.  For  fixed  computational  resources  and  sampling  rates,  however,  such 
increases  can  exceed  the  limited  time  available  to  perform  the  necessary  calculations.  Thus,  if  longer 
FIR  filters  are  desired,  then  either  a  change  in  the  algorithm  is  required  or  a  new  implementation 
of  the  algorithm  is  needed. 

In  this  paper,  we  apply  and  extend  a  recently-devefoped  method  for  computing  convolutions 
via  block  updates  [6,  7]  to  five  different  algorithms  for  single-channel  feedforward  active  noise 
control.  By  choosing  a  block  length  of  two,  we  guarantee  that  the  input-output  characteristics 
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of  the  original  algorithms  are  unchanged  in  our  new  implementations,  unlike  other  proposed  block 
update  methods  that  introduce  significant  delays  into  the  coefficient  updates  [5].  In  many  cases,  the 
new  implementations  use  approximately  25%  fewer  multiplications  as  compared  to  their  original 
implementations,  and  they  require  fewer  additions  as  well.  Thus,  our  implementations  should 
allow  for  longer  controller  filters  for  fixed  computational  resources  and  sampling  rates  while  still 
guaranteeing  equivalent  controller  behavior. 

The  organization  of  the  paper  is  as  follows.  In  Section  II,  we  describe  the  filtered-X  LMS 
algorithm  [1].  We  then  describe  the  fast  convolution  method  employing  block-of-two  operations  and 
apply  the  method  to  the  filtered-X  LMS  algorithm.  In  Sections  III,  IV,  V,  and  VI,  we  apply  similar 
methods  to  the  active  noise  control  LMS  (ANC-LMS)  algorithm  [2],  the  fast  ANC-LMS  algorithm 
[3],  the  periodic  filtered-X  LMS  algorithm  [4],  and  the  sequential  filtered-X  LMS  algorithm  [4]. 
Tables  of  the  new  implementations  are  provided  in  each  case,  and  an  overall  comparison  of  the 
algorithms’  complexities  is  given  in  Section  VII. 


II.  THE  BLOCK-UPDATE  FILTERED-X  LMS  ALGORITHM 


In  the  filtered-X  LMS  algorithm  for  active  noise  control. ‘the  coefficient  updates  are  given  by 

W(n  +  1)  =  W(n)  -/i(n)f(n)F(n),  (3) 

where  W(n)  and  e(n)  are  as  defined  before,  F(n)  =  [J(n)  ■■■  f{n  -  L  +  l)]r  contains  the  L 
most-recent  samples  of  the  filtered  input  signal,  and  n(n)  is  the  step  size  at  time  n.  In  this  system. 
f(n)  is  computed  as 

/(n)  =  HTX(n-  1),  (4) 


where  X(n  -  1)  =  [x(n  -  1)  •  •  •  x(n  -  M)]T  contains  M  samples  of  the  input  signal.  The  output 
of  the  controller  is  computed  as  in  (1).  Considering  (1),  (3),  and  (4),  we  find  that  this  algorithm 
requires  2L  +  M  +  1  multiplications  and  2L  +  M  -  2  additions  per  time  step,  and  it  employs 
2L  +  M  +  ma x(L,  M  +  1)  +  3  memory  locations  within  the  controller. 

We  now  describe  a  method  for  simplifying  the  implementation  of  a  fixed-coefficient  FIR  filter 
that  calculates  terms  that  can  be  reused  at  successive  time  instants  to  calculate  the  output  signal 
[6].  Two  successive  outputs  of  a  FIR  filter  with  fixed  coefficient  vector  W  can  be  computed  as 


'  XT(n  -  1)  ' 

w  — 

'  XT(n  -  1) 

XT(n-2)  ' 

'  W0  ' 

.  XT(n) 

V  v  — 

XT(n) 

XT(rz-  1) 

Wi  _ 

(5) 


where 

X(n)  =  [x(n)  x(n  -  2)  •  •  •  x(n  —  L  +  2)]T  (6) 

W i  =  [Wi  w2+i  •  •  •  vi L- 2+<]T  •  (7) 


Expanding  the  last  term  on  the  right-hand-side  of  (5),  we  get 


y(n  —1) 

'  XT(n-l)(W0  +  W1)  +  (XT(n-2)-XT(n-l)]W1  ' 

y{n) 

. 

%T(n  -  1)  (W0  +  WO  —  (XT(n  -  1)  -  XT(n))W0 

'  xw(n  —  1)  +  X^(n  —  l)Wx  ' 

xw(n  —  1)  —  X^(n)W0 

xw(n)  =  XT(n)(  Wq  +  Wj) 
XA(n)  =  X(n  -  1)  -  X(n) . 


where  we  have  defined 


(10) 

(11) 
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Computing  the  right-hand  side  of  (9)  requires  1.5L  multiplications,  since  the  multiplications  needed 
to  compute  xw(n)  are  common  to  both  time  steps  and  are  performed  only  once.  Therefore,  this 
implementation  of  the  fixed-coefficient  FIR  filter  uses  0.75 L  multiplies  per  time  step  on  average, 
a  savings  of  0.25L  multiplies  over  the  standard  FIR  filter  implementation.  Moreover,  storing  the 
difference  terms  x(n-i)-x(n  —  i- 1)  in  Xa(»)  reduces  the  number  of  additions  needed  to  compute 
the  filter  output  at  the  expense  of  additional  memory. 

When  W(n)  is  time-varying,  the  coefficient  updates  must  be  included  within  the  above  calcu¬ 
lations.  In  [7],  a  method  for  calculating  the  outputs  and  updates  for  the  LMS  adaptive  filter  in  a 
block  fashion  is  described.  We  now  extend  this  method  to  the  filtered-X  LMS  algorithm.  First,  we 


rewrite  equations  (1)  and  (3)  at  time  n  —  1,  which  gives 

y(n  —  1)  =  XT(n  —  1)  W  (n  —  1)  (12) 

W(n)  =  W(n  -  1)  -y(n  -  l)e{n  -  l)F(n  -  1)  .  (13) 

Substituting  equation  (13)  into  equation  (1),  we  obtain 

y(n)  =  XT(n)  (W(n  -  1)  -  y(n  -  i)e{n  -  l)F(n  -  1))  (14) 

=  X^(n)W(n  -  1)  —  y(n  —  l)e(n  —  l)rx/(n)  ,  (15) 

where  we  have  defined 

rxJ(n)  =  Xr(n)F(n-l).  (16) 


Considering  two  successive  output  samples,  we  can  write 


y(n-  1) 

y{n) 


XT(n  -  1) 
XT(n) 


W  (n  -  1)  - 


0 

y(n  -  l)e(n  -  l)rx/(n) 


(17) 


The  first  term  on  the  right-hand-side  of  (17)  has  the  same  form  as  that  in  (5).  Therefore,  we  can 
use  (9)  to  write  this  relationship  as 


y(n  -  1) 

'  xw(n  -  1)  +  Xj(n  -  l)W1(n  -  1)  ' 

0 

_  y{n ) 

xw(n  —  1)  —  X^(n)W0(n  —  1) 

y(n  -  l)e(n  -  l)rx/(n) 

with 


W;(n)  =  [iui(n)  w2+i{n)  •  • -jVL^+iin)]7  (19) 

xw(n)  =  ^(WoW  +  W^n)).  (20) 

To  compute  rxf(n)  in  an  efficient  manner,  we  note  that 

L 

rs/(n )  =  ]Tx(n  -  i)f(n  -  i  -  1)  (21) 

;=o 

=  rx/(n  -  1)  +  x(n)f(n  -  1)  -  x(n  -  L)f(n  -  L  -  1)  (22') 

=  rxf(n-2)  + Axf(n)  -  Axf(n- L)  ,  (23) 


where 


A xf(n)  =  x(n)f(n-  1)  +x(n-  l)/(n  -  2)  . 


(24) 
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The  procedure  for  computing  [f(n  - 1)  f{n)]T  is  similar  to  the  original  fast  convolution  method 
in  (9),  as  the  value  of  H  is  fixed.  The  resulting  equations  are 


f{n  -  1) 

'  !,(«-  1)  +  Xl(n-  l)Hx 

.  /(») 

*fc(n-l)-5£(n)Ho 

where  we  define 

XA(n)  =  X(n-1)-X(n)  (26) 

H,  =  [hx+ihs+i  •••  ft.v— i*;]7  (2T) 

X(n)  =  [x(n  -  1)  x(n  -3)  •  •  •  x(n  -  M  +  1)]T  (28) 

xh(n)  =  XT(n)HA  (29) 

Ha  =  Ho+ti-  (3°) 

A  similar  method  could  be  used  to  compute  [e(n  -  1)  t(n)]T  for  simulation  purposes:  in  practice, 
however,  e(n)  is  measured  by  the  error  sensor  and  need  not  be  computed. 

To  update  the  filter  coefficients,  we  consider  two  successive  iterations  of  (3)  to  obtain 

W(n+1)  =  (W(».  -  l)  —  fi\n  -!}(.(»-  L ;  F  ( //.  —  l))  -  /.t(n)c(n)F{n).  (31) 


or,  equivalently, 

'  W0 (n  +  1) 
W[(n  +  1) 


where  we  have  defined 


r-H 

1 

*■- 

3 

i - 

— { 

\ 

_ 1 

[  W0(n  -  1)  ' 

£3 

1 

i — * 

F(n  -  1  )n(n  -  l)c(n  -  1)  +  F(n)^(n)c(n) 

F(n  -  2 )n(n  -  l)c(n  -  1)  +  F(n  -  l)#t(n)«(n) 

F e(n  -  1)  -  FA(n)/r(n)e(n) 

F c{n  -  1)  +  F±{n  -  1  )n(n  -  l)f(n  -  1)  J  ’ 


F  A(n)  =  F(n-1)-F(n) 

F(n)  =  [f{n)  f(n  —  2)  •  •  •  f(n  -  L  +  2)]r 
Ft(n)  =  F(n)(/r(n)c(n)  +  n(n  +  l)c(n  +  1))  . 


(32) 

(33) 


(34) 

(35) 

(36) 


Table  1  list  the  equations  for  the  block-of-two  implementation  of  the  filtered-X  LMS  algorithm 
along  with  the  number  of  multiplications  and  additions  needed  for  each  step.  In  the  table,  a 
horizontal  line  separates  the  operations  necessary  at  each  time  step;  however,  it  is  possible  to 
shift  some  of  the  calculations  from  the  second  half  of  the  block  to  the  first  half  to  balance  the 
computational  load  of  the  algorithm  at  each  sample  time.  This  algorithm  requires  3 L  +  1.5 A/  +  7 
multiplications,  AL  +  1.5 M  +  8  additions,  and  2.5 L  +  1.5/V/  +  1.5max(Z>,  M  +  1)  +  14  memory 
locations  per  two  sample  times.  Thus,  the  maximum  number  of  multiplications  per  sample  time  is 
approximately  1.5L  +  0.75M  +  4,  which  represents  a  savings  of  approximately  25%  over  that  of  the 
original  implementation. 


III.  THE  BLOCK-UPDATE  ANC-LMS  ALGORITHM 


In  the  filtered-X  LMS  algorithm,  the  error  signal  e(n)  depends  on  past  values  of  y(n),  which  in  turn 
depend  on  past  values  of  W(n).  Since  past  controller  coefficients  appear  in  the  error  signal,  the 
adaptation  performance  of  this  system  is  worse  than  that  of  an  algorithm  with  no  such  coefficient 
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Block- Update  Filtered-X  LMS 


Equation 


Multiplication*  \  Additions 


e(n  -  1)  =  d(n  -  1)  +  HrY(n  -  2) 

—  U  -  **(n  - 1)«(«  -  i) 

-(n_J)  ] 

L_X(n  -  3)J 

=  X  (n  -  1)H4 

x(n  —  2)  —  x(n  —  1) 


XA(n-l)  = 
XA(n-l)  = 


XA(n-3) 
x(n  — J3)  —  x(n  —  2) 

£a(«-3) 


/(n  -  1)  =  *h  (n  -  1)  +  XA(n  -  1)H 
r  /(n-1)  I 

i” | 

L  Fd(n-3)  J 

r  x(n-l)  1 
X(n-1)=  ~ 

Lx(n  -  3)  l 

x„(n  -  1)  =  Xr(n  -  l)(W0(n  -  l)  +  W:(n  -  1)) 
y(Tt  -  1)  a  xw(n  -  1)  +  X^(n  -  pW^n  -  1) 


y(n  -  1)  a  xw(n  -  1)  +  X‘ 
«£(n)  =  d(n)  +  HJ  Y(n  -  1) 
cu(")  =  M(«)e(n)  f 
~  f  x(n  —  1 1  1 

X(n)  =  “ 

L  X(n-2 


) 

X(n  —  2)  j 

~  .  .  r  r(2_-  o  -  1 

XA(n)  =  ~ 

X  A{»»  —  2)  J 

~  x(n  -2)  ~x(n  -  1) 

L(n)  =  ~ 

L  ^Sr~2l 

/(")  =  Tf,  (n  -  1)  -X^(n)H0 

P(..)=[~/(n)  1 

L  F(n-2)  j 

L  FA(n-2) 

X(»)  =  [  -X(n)  ^ 

L  X(n  —  2) 
rx/(n)  =  rx/("  “21 


x,">  ■  [  ?,»->,  i 

rxf  (n)  =  rxf  -  2)  +  x(n)/(n  -  1)  +  x(n  -  l)/(n  -  2) 

-x(n  -  L)f{n  -  L  -  1)  -  i(n  -  L  -  l)/(n  —  L  —2) 
y{n)  =  xw(n-  1)  -  xJ(n)W0(n  -  l)  -  (n  -  l)rx/(n) 

Fe(n-1)  =  F(r*-l)(<&(n-l)  +  eM(n)) 

W0(n+1)  If  W0(n-1)  1  _  £<("  -  1)  -  £A(n)^(n) 

.  Wtjnjl)  J  Wx(n-l)  J  Ft(n~l)f  FA(w-l)tu(n 

' ’’otoij  (two  time  steps) 


1 

0 

G.5Af 

0 


measured 
0 


0.5  Af 
0 


0.5  £■ 
0.5  L 


0.5Af  -  1 
1 

previously  calculated 

0.5  M 
0 


L  -  l 
0.5  Z. 


measured 
0 


previously  calculated 


0.5  M 
0 


0.5L  +  l 
0.5A 


0.5.U 

0 

1 

0 

4 

0.5  L  +  L 
1 

2  L 


3  L  -f  1.5M  +  7  j  4L+  1.5AZ  + 


Table  1:  Equations  for  the  block-update  filtered-X  LMS  algorithm. 

delays  [8].  A  method  to  effectively  remove  these  delays  within  the  filtered-X  LMS  updates  is 
described  in  [2],  In  this  algorithm,  a  modified  error  signal  e(n)  is  calculated  as 

e(n)  =  6(n)  -  HrY(n  -  1)  +  Fr(n)W(n),  (37) 

where  y(n)  and  /(n)  are  computed  as  in  (1)  and  (4),  respectively.  The  coefficients  of  the  controller 
are  then  updated  as 


W(n-f-l)  =  W(n)  -  p(n)e(n)F(n) .  (38) 

If  the  coefficients  in  the  secondary  path  model  H  are  accurate,  then  this  system’s  adaptation 
behavior  is  similar  to  that  of  the  LMS  adaptive  filter  with  input  signal  f(n )  and  desired  response 
signal  d(n).'  For  this  reason,  we  shall  refer  to  (37)— (38)  as  the  active  noise  control  LMS  (ANC- 
LMS)  algorithm.  This  algorithm  requires  3L  +  2M  +  1  multiplies,  ZL  +  2M  -2  additions,  and 
2L  +  2 M  +  max(L,  M  +  1)  +  3  memory  locations  per  iteration  to  implement. 

We  now  derive  a  block-of-two  implementation  of  the  ANC-LMS  algorithm  that  is  similar  to 
that  of  the  filtered-X  LMS  algorithm  in  Section  II.  In  fact,  the  equations  for  y(n),  rxf(n),  and  f(n) 
are  the  same  as  those  for  the  filtered-X  LMS  algorithm  as  given  in  equations  (18)-(20),  (23)-(24), 
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and  (25)-(30)  respectively.  Moreover,  given  [e(n  -  1)  e(ra)]T,  the  updates  for  W(n)  are  similar  to 
those  in  (33)— (36)  and  are  given  by 


'  W0(n  +  1)  ' 

'  Wo(n-l)  ' 

_  Wi(n  +  1)  _ 

_  Wi(n  -  1) 

L 

where 


Fe(n  -  1)  -  FA{n)n(n)e{n) 

[  Fe(n  -  1)  +  F^(n  -  1  )/x(n  -  l)e(n  -  1)  J 


Fe(n)  =  F(n)(/z(n)e(n)  +  /*(n  +  l)e(n  +  l)). 


(39) 


(40) 


e(n  -  1) 

c(«  -  1) 

'  YT(n  -  2)H  ‘ 

J_ 

'  FT(n  -  1)W (n  —  1) 

_  e(n) 

_  c(n) 

Y T(n  -  1)H 

1 

Fr(n)W(n) 

In  this  algorithm,  additional  computations  are  required  to  compute  e(n)  in  a  block  fashion.  We 
can  express  [e(n  —  1)  e[n)]T  as 

“1  r  m  _ T  r  _ 'T>  ,  .  - - -  /  ^  \  T 

(41) 

The  second  term  on  the  right-hand-side  of  (41)  is  of  the  form  in  (5),  and  thus  (9)  can  be  used 
to  compute  it.  Finally,  the  last  term  on  the  right-hand-side  of  (41)  can  be  computed  in  a  fashion 
similar  to  that  used  for  y(n),  except  that  the  filtered  input  signal  f(n)  is  used  instead  of  the  input 
signal  x{n)  in  the  calculations.  Therefore,  the  resulting  computations  for  [e{n  -  1)  c(u)]  are 

y/l(n-2)  +  £l(n-2)H1 

yh(n  -  2)  -  il(n  -  1) H0 

r  .  1 

(42) 


e(n  -  1) 

e(n  -  l) 

_  e{n) 

_  c(n) 

+ 


'  fw(n  —  1)  +  F^(n  -  lJW^n  -  1)  ' 

’  0 

.  U(n  -  1)  -  fl(n)W0(n  -  1)  . 

y(n  -  l)e(n  -  1 )»’//(«) 

where 


YA(n)  =  Y(n-1)-Y(n) 

Uh(n )  =  YT(n)(20  +  Ei) 

Y(n)  =  [y(n)  y(n  -  2)  •  •  •  y{n  -  M  +  2)]r 
fw(n)  =  FT(n)(W0(n)  +  Wi(n)) 
r//(n)  =  rJf{n-2)  +  Afj{n)  -  AfJ{n-  L) 

A//(n)  =  f{n)fin  ~  !)  +  /(n  -  l)/(n  ~  2)  • 


(43) 

(44) 

(45) 

(46) 

(47) 

(48) 


Note  that  equation  (42)  assumes  that  e{n  -  1)  is  computed  before  e(n),  so  that  e(n  -  1)  can  be 
used  in  the  last  term  on  the  right-hand-side  of  (42). 

Table  2  lists  the  equations  and  the  number  of  operations  needed  by  the  block  ANC-LMS  algo¬ 
rithm  for  two  time  steps.  This  algorithm  requires  4.5L  +  3 M  +  12  multiplications,  6 L  +  3 M  +  17 
additions,  and  2.5L+3M+1.5max(L,  M+l)+15  memory  locations  for  two  time  steps.  With  proper 
partitioning  of  the  operations  over  successive  time  samples,  it  uses  a  maximum  of  2.25 L  + 1.5 M  +  6 
multiplications,  which  represents  a  sayings  of  roughly  25%  over  that  of  the  original  implementation. 

IV.  THE  BLOCK-UPDATE  FAST  ANC-LMS  ALGORITHM 

If  the  output  actuator  of  the  controller  is  located  near  the  error  sensor  and  the  acoustic  plant  is 
not  overly-resonant,  then  it  may  be  possible  to  select  the  plant  model  filter  length  M  such  that 
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L  >  3 M.  In  such  cases,  a  more-efficient  alternate  form  of  the  ANC-LMS  algorithm  can  be  used  [3]. 
This  algorithm  employs  an  efficient  method  for  calculating  e(n)  in  (37),  as  given  by 


e(n) 

U(n) 

R ./(«) 


e(n)  +  HTU(n  -  1) 

0 

U(n  -  1) 

Rx/in  -  1)  +X(n)/(n)  -  X(n  -  L)f(n  -  L) 


-  R xj(n)fi(n)e(n) 


(49) 

(50) 

(51) 


where  U(n)  and  R„f  f n  —  1)  are  M-dimensional  vectors  and  U(n)  contains  the  first  M  —  1  elements 
of  U(n).  All  of  the  other  quantities  are  calculated  as  in  the  ANC-LMS  algorithm  as  given  by 
equations  (1),  (4),  and  (38).  In  its  original  implementation,  this  algorithm  requires  2 L  +  5 M  +  1 
multiplications,  2 L  +  5A7  —  2  additions,  and  3 L  4-  3 \l  -(-  4  memory  locations  at  each  sample  time. 

We  now  derive  a  block-of-two  implementation  of  the  fast  ANC-LMS  algorithm.  This  imple¬ 
mentation  computes  /(n),  y(n).  and  W(n)  in  the  same  fashion  as  the  block-update  ANC-LMS 
algorithm.  Only  the  calculations  for  e{n)  are  different  and  are  given  by 


e(n  -  1) 

«(«  -  1) 

_L 

’  ah(n  -  1)  +  (Uf (7,.  -  2)  -  Uj( n  -2))H,  " 

.  e 

_  Mn  -  1)  -  (U J(n  -  2)  -  Ul,(«  -  2))H„  _ 

rff(n  -  1  )fi(n  -  l)e(n-  1) 


where 

r//(n  —  1)  =  HTSr/(»-l)  (53) 

uh(n)  =  Uj(n-1)(H0  +  Hi)  (54) 

Ui(n)  =  [ui(nj  u;+2(n)  •  ■  •  ut+Jv/-2(^)]T  >  (55) 

Ui(n )  is  the  (i  +  l)th  element  of  U(n),  and  u,  (n)  =  0  for  i  <  0.  Moreover,  the  term  rJf(n)  in  (52  ) 
can  be  easily  computed  as 


L- 1  L-i 

rff(n)  =  £  HrX(n -*' -!)/(«-*- 1  )  =  Z) /("-*)/(»-* -1) 

t=0  1=0 

=  r//(n  -  1)  +  f(n)f{n  -  1)  -  f{n  -  L)f{n  -  L  -  1). 


(56) 

(57) 


The  updates  for  U(n)  and  R xj{n)  in  this  block  version  are  the  same  as  in  (50)  and  (51)  and  are 
performed  twice  per  block. 

Table  3  lists  the  operations  for  the  block-of-two  implementation  of  the  fast  ANC-LMS  algorithm. 
The  version  employs  ZL  +  9 M  +  12  multiplications,  4 L  +  9.5 M  +  14  additions,  and  4L  +  5 M  +  16 
memory  locations  for  two  time  steps.  Thus,  the  algorithm  requires  approximately  1.5L  +  4.5M  +  6 
multiplications  at  each  sample  time,  which  represents  a  savings  of  0.5(L  +  M)  multiplications  per 
sample  time  as  compared  to  those  of  the  original  implementation. 


V.  THE  BLOCK-UPDATE  PERIODIC  FILTERED-X  LMS  ALGORITHM 

In  some  situations,  the  reductions  in  complexity  provided  by  the  previously-described  methods 
may  not  be  sufficient  to  allow  the  chosen  algorithm  to  be  implemented  on  the  available  hardware 
platform.  In  these  situations,  it  is  reasonable  to  consider  alternative  algorithms  that  sacrifice  some 
adaptation  performance  while  reducing  the  implementation  complexity  of  the  overall  system.  In 
this  section,  we  consider  a  modification  of  the  filtered-X  LMS  algorithm  in  which  every  77th  error 
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signal  e{n)  is  used  to  adjust  the  coefficients  of  the  system.  Termed  the  periodic  filtered-X  LMS 
algorithm  [4],  the  coefficient  updates  for  this  system  are  given  by 


Wi{n  +  1) 


r 

W{(n)  -  fi(l)e(l)f(n- i  +  1) 
k  wi(n ) 


if  (n  +  i)modfV  =  0 
and  l  —  N  mod(n/iVj 
otherwise 


(58) 


This  algorithm  updates  L/N  coefficients  at  each  time  step;  thus,  after  N  time  instants,  all  coeffi¬ 
cients  have  been  updated  using  the  same  error  signal.  All  other  equations  for  this  scheme  are  the 
same  as  that  for  the  filtered-X  LMS  algorithm.  For  N  =  2,  this  algorithm  requires  1.5 L  +  M  +  1 
multiplications,  1.5L  +  M  -  2  additions,  and  2 L  +  M  +  max(L,  M  +  1)  +  3  memory  locations  per 
time  step  to  implement. 

We  can  easilv  develop  a  block-of-two  implementation  of  the  periodic  filtered-X  LMS  algorithm 
by  noting  that  the  coefficient  updates  over  two  time  instants  are  given  by 


W(n  +  1)  =  W(n-l)-/i(n-l)«(n-l)F(n-l). 


(59) 


In  addition,  the  correlation  term  rxf(n)  has  a  two-time-step  recursipn  as 

rxJ{n)  =  rxJ(n  -  2)  +  x{v  -  l)/(n  -  2)  -  x{n  -  L  -  l)f{n  -  L  -  2).  (60) 

The  remaining  equations  are  the  same  as  those  of  the  block  filtered-X  LMS  algorithm  of  Section  II. 
except  that  the  calculations  for  F^(tz  —  z)  and  Ft(?i  —  z)  are  not  required. 

Table  4  lists  the  equations  and  number  of  operations  for  this  algorithm.  The  algorithm  requires 
2.5L  +  1.5 M  +  4  multiplies  and  3 L  +  1.5M  +  3  additions  per  two  time  steps  and  uses  3 L  +  1.5 M  + 
1.5max(L,  M  +  1)  +  3  memory  locations.  With  proper  partitioning  of  the  operations  across  each 
sample  time,  the  maximum  number  of  multiplications  required  is  1.25L+0.75M+2.  which  represents 
a  savings  of  0.25(L-|-  M)  multiplies  over  the  original  implementation. 

VI.  THE  BLOCK-UPDATE  SEQUENTIAL  FILTERED-X  LMS  ALGORITHM 

While  the  periodic  filtered-X  LMS  algorithm  described  in  the  last  section  updates  only  L/N  coef¬ 
ficients  at  each  iteration,  it  requires  the  calculation  of  every  filtered  input  signal  f{n).  In  [4],  an 
alternative  algorithm  is  described  that  uses  every  iVth  value  of  the  filtered  input  sequence,  which 
saves  computations  in  active  noise  control  applications.  Termed  the  sequential  filtered-X  LMS 
algorithm,  the  coefficient  updates  are  given  by 

f  Wi(n)  -  n(n)e(n)f(n  —  i  +  1)  if  (n  -  i  +  l)modiV  =  0 
Wi(n  +  1)  —  ^  W{(n)  otherwise 

When  N  =  2,  these  updates  can  be  conveniently  represented  as 


'  Wo(n  +  l)  ‘ 

'  W0(n  -  1)  ' 

/z(n  -  l)e(n  -  l)F(rz  -  1) 

.  W[(n  +  1)  _ 

Wi(n-  1) 

^z(n)e(n)F(n  —  1) 

and  the  output  signal  is  computed  using  (1).  This  algorithm  requires  1.5L+0.5M+1  multiplications 
and  1.5L  +  0.5M- 1  additions  at  each  time  step  on  average.  It  uses  2L  +  0.5M  +  max(L,  M+  1)  +  3 
memory  locations.  As  is  shown  in  [4]  for  noise  cancellation  tasks,  the  average  performances  of  the 
sequential  and  periodic  LMS  algorithms  are  nearly  identical  for  the  same  coefficient  update  rates. 

We  now  state  the  block-update  version  of  the  sequential  filtered-X  LMS  algorithm.  In  this  case, 
the  fast  convolution  technique  is  only  applied  to  the  input-output  controller  calculation,  and  the 
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Comparison  of  Original  and  Block-Update  Algorithms 
resource  u»oge  per  time  step. _ 


|  Algorithm  ||  Multiplies  1  Additions  (  Memory  | 


FXLMS 

2L  +  M  +  1 

2L  +  M  —  2 

2 L  +  M  +  mix(  L,  M  +  1)  +  3 

Block  FXLMS 

1.5L  +  0.75M  +  4 

2  L  +  0.75M  +  A 

2.5 L  +  1.5jW  +  1.5mix(  L,  M  +  1)  +  14 

ANC-LMS 

3L  +  2M  +  1 

3L  +  2M  -  2 

2L  +  2M  -f  max(L,  M  +  1)  +  3 

Block  ANC-LMS  “ 

2.25  L  +  1.5  M  +  6 

3  L  +  I.SAf  +  9 

2.5 L  +  3M  +  1.5max(L,  M  +  1)  +  15 

Fast  ANC-LMS 

2L  +  5Af  +  l 

2L  +  5Atf  —  2 

3L  +  3M  +  4 

Block  Fast  ANC-LMS 

1.5L  +  4.5M+6  | 

2  L  +  4.75M  +  7 

4L+5M+  16 

Periodic  FXLMS 

1.5  L  +  M  +  1 

1.5  L  +  M  —  2 

2L  +  M  +  max(L,  M  +  I)  +  3 

Block  Periodic  FXLMS 

1.25L  +  0.75M  +  3 

rsTTr  o.75M  +  4 

3 L  +  I.SAf  +  1.5max(  L,  M  +  1)  +  3 

Sequential  FXLMS 

1.5  L  +  0.5M  +  1 

1.5 L  +  0.5M  -  1 

2L  +  Af  +  max(L,  M  +  1)  +  3 

Block  Sequential  FXLMS 

1.25L  +  0.5M  +  3 

1.5 L  +*  0.5 Af  +  2 

2 L  +  l.5Af  +  l.5max(  L,  M  +  1)  +  11 

Table  6:  Complexity  comparison  of  standard  and  block-update  algorithms. 

calculations  associated  with  computing  f(n)  for  even  time  instants  can  be  removed.  Table  5  shows 
the  operations  for  this  version  of  the  algorithm.  This  method  requires  2.5Z-  —  37  +  5  multiplications. 
3 L  +  M  +  3  additions,  and  2 L  +  1.5 M  +  1.5max(Z,,  M  +  1)  +  11  memory  locations  to  implement 
for  two  time  steps.  Thus,  the  average  number  of  multiplies  per  time  step  is  1.25Z,  +  0.5 M  +  3,  a. 
savings  of  approximately  0.25L  multiplications  over  the  original  implementation. 

VII.  SUMMARY  AND  CONCLUSIONS 

In  summary,  we  have  derived  new  implementations  of  several  existing  algorithms  for  feedforward 
active  noise  control.  Table  6  summarizes  the  number  of  multiplications  additions,  and  memory 
required  for  the  standard  and  block-of-two  implementations  of  the  algorithms.  Onr  results  indicate 
that  the  fast  convolution  technique  is  effective  at  reducing  the  complexities  of  these  algorithms, 
and  up  to  a  25%  reduction  in  multiplications  can  be  achieved  in  some  cases. 
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1  Introduction 


In  active  noise  control  (ANC),  unwanted  acoustic  noise  caused  by  a  primary  source  is  attenuated 
by  injecting  via  a  secondary  source  an  acoustic  field  that  that  is  equal  in  magnitude  and  opposite 
in  phase  to  that  of  the  unwanted  noise  in  a  physical  region  of  interest.  The  two  acoustic  fields 
destructively  interfere,  thereby  reducing  the  level  of  the  unwanted  acoustic  noise.  Due  to  the 
advances  in  digital  signal  processing  (DSP)  hardware,  ANC  has  become  practical  for  many  useful 
applications  [1]— [10] .  As  more-advanced  hardware  and  more-efficient  algorithms  are  developed, 
ANC  will  likely  become  a  common  method  for  attenuating  unwanted  acoustic  noise. 

Figure  1  shows  a  block  diagram  of  a  single-channel  feedforward  ANC  system.  An  input  signal 

x(n)  is  measured  and  processed  by  a  time-varying  finite-impulse-response  (FIR)  filter  as 

L- 1 

y(n )  =  ^  wi(n)x{n  -  l)  =  XT(n)W(n),  (1) 

1=0 

where  the  vector  X(n)  =  [z(n)  *  •  •  x(n  —  L  +  l)]r  contains  the  L  most-recent  samples  of  the  input 
signal  and  W(n)  =  [wo(n)  *  •  *  wl- i(n)]T  is  the  coefficient  vector  of  the  controller  at  time  n.  The 
output  signal  of  the  controller  propagates  to  the  desired  quiet  region,  where  it  combines  with  the 
primary  signal  to  be  canceled,  denoted  by  d(n).  An  error  sensor  measures  the  linear  combination 
of  these  two  signals  as  modeled  by  the  equation 

e(n)  =  d(n)  +  HrY(n  —  1),  (2) 

where  e(n)  is  the  measured  error  signal,  Y(n  —  1)  =  [y(n  —  1)  •  •  •  y(n  —  M)]T  and  where  the  FIR. 
filter  with  impulse  response  H  =  [h\  ■  •  •  is  assumed  to  accurately  represent  the  transfer 

characteristics  of  the  output-actuator-to-error-sensor  secondary  path.  The  task  is  to  adjust  W(n) 
so  that  the  magnitude  of  e(n)  is  reduced  over  time. 

Various  algorithms  for  adjusting  W(n)  for  ANC  have  been  proposed  [1 1]— [21].  For  the  most 
part,  they  involve  multiply  and  add  operations  that  are  similar  to  the  FIR  filter  output  calculation, 
and  they  typically  employ  an  estimate  of  the  secondary  path  impulse  response  in  H.  Although 
multiply  and  add  operations  are  simple  to  implement  in  typical  real-time  DSP  hardware,  it  is  often 
desirable  to  minimize  the  arithmetic  complexities  of  these  algorithms  I)  to  allow  the  algorithm  to 
be  implemented  on  a  less-expensive  processor  platform;  2)  to  reduce  the  demands  on  a  particular 
processor  platform  so  that  other  operations  can  be  simultaneously  performed  by  the  system:  or 
3)  to  obtain  higher  cancellation  performance  in  broadband  noise  control  applications  on  a  given 
processing  platform  by  increasing  the  lengths  of  W(n)  and  H  so  that  the  controller  can  more 
accurately  represent  the  physical  paths  within  the  system. 
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Recently,  a  fast  exact  LMS  algorithm  was  introduced  that  exactly-computes  the  outputs  of 
the  LMS  adaptive  filter  while  reducing  the  overall  complexity  of  the  system  via  block  coefficient 
updates  [23].  The  method  reduces  the  number  of  multiplies  required  by  the  system  by  25%  for  a 
block  length  of  two  while  keeping  the  number  of  adds  approximately  the  same,  and  greater  savings 
can  be  obtained  for  larger  block  lengths. 

In  this  paper,  we  extend  the  fast  convolution  and  updating  methods  employed  within  the 
fast  exact  LMS  algorithm  [22,  23]  to  five  different  single-channel  ANC  algorithms:  the  filtered-X 
LMS  [11,  12],  modified  filtered-X  LMS  [13,  14,  15],  efficient  modified  filtered-X  LMS  [20],  periodic 
filtered-X  LMS  [19],  and  sequential  filtered-X  LMS  [19]  algorithms,  respectively.  Choosing  a  block 
length  of  two  guarantees  that  the  input-output  characteristics  of  the  original  implementations  are 
exactly  maintained  in  our  new  implementations,  unlike  other  block-update  methods  that  introduce 
significant  delays  into  the  coefficient  updates  [17].  We  show  that  the  numbers  of  multiplies  required 
for  the  new  implementations  are  reduced  by  as  much  as  25%  over  their  original  implementations, 
and  the  numbers  of  adds  required  by  the  algorithms  are  also  reduced.  We  then  describe  a  real-time 
implementation  of  the  fast  exact  filtered-X  LMS  algorithm  on  the  Motorola  DSP96002  processor. 
Real-time  experiments  indicate  that  the  new  implementation  provides  mathematically-equivalent 
behavior  to  that  of  the  standard  implementation.  Because  of  its  computational  efficiency,  however, 
the  new  implementation  allows  the  system  filter  lengths  to  be  increased  by  as  much  as  27.4%  over 
those  of  the  original  implementation  without  failure,  a  factor  close  to  the  33.3%  increase  suggested 
if  the  number  of  multiplies  were  a  true  indication  of  an  algorithm’s  complexity. 

This  paper  is  organized  as  follows.  In  the  next  section,  we  describe  fast  exact  methods  for 
convolution  and  the  coefficient  updating  of  an  LMS  adaptive  filter.  Section  3  provides  extensions 
of  these  methods  to  the  five  different  ANC  algorithms  mentioned  previously  and  compares  their 
computational  complexities  to  those  of  their  original  implementations.  We  discuss  an  implementa¬ 
tion  of  the  fast  exact  filtered-X  LMS  algorithm  on  the  Motorola  DSP96002  processor  in  Section  4, 
and  real-time  experiments  are  described.  Section  5  presents  our  conclusions. 

To  aid  the  reader,  Table  1  lists  the  notation  used  in  this  paper.  In  most  cases,  the  notation 
follows  similar  conventions  used  in  the  presentation  of  other  adaptive  algorithms  in  the  literature. 

2  Review  of  Fast  Exact  Methods 

Before  presenting  the  new  algorithms,  we  first  review  previously-derived  methods  for  the  fast 
exact  implementation  of  constant-coefficient  and  gradient  adaptive  FIR  filters  [22,  23].  Our  pre- 
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sentation  uses  a  generalized  notation  that  allows  us  to  apply  the  methods  to  other  algorithms  in 
Section  3.  Here,  we  focus  on  a  block-of-two  implementation,  in  which  two  successive  outputs  or  up¬ 
dates  are  computed  in  parallel,  as  this  implementation  allows  for  mathematically-exact  zero- latency 
real-time  controller  implementations  in  the  algorithms  of  Section  3. 

2.1  Fixed-Coefficient  Fast  FIR  Convolution 


In  [22],  a  simplified  fixed-coefficient  FIR  filter  implementation  is  described  that  calculates  terms 
that  can  be  reused  at  successive  time  instants  to  calculate  the  filter  output  signal  via  low-complexity 
correction  terms.  Two  successive  outputs  from  an  L-coefficient  FIR  filter  with  input  signal  x (n) 


and  coefficient  vector  W  =  [wq  ■  ■  ■  wl-\Y  can  be  computed  as 

W0 
Wi 

where 


y(n  -  1) 

XT(n  -  1) 

w  = 

XT(n  —  1)  Xr(n-2) 

y(n) 

.  XT(n) 

XT(n)  XT(n  —  1) 

(3) 


X(n)  =  [x(n)x{n  —  2)  ■  ■  ■  x(n  -  L  +  2)}T  (4) 

W,  =  [W{  w2+i  ■  ■  ■  wL-2+i]T  •  (5) 

Expanding  the  last  term  on  the  RHS  of  (3)  and  adding  and  subtracting  the  term  XT(n  -  1)^ 
from  both  entries  gives 

y(n  -  1) 

_  y(n) 

where  we  have  defined 


xw{n  -  1)  +  Xl(n  -  lJWi 
xw(n  -  1)  -  XA(n) W0 


xw(n)  =  XT(n)(  Wo+WO 

(7) 

XA(n)  =  X(n  —  1)  —  X(n)  . 

(8) 

Equations  (6)  and  (7)  constitute  the  fast  FIR  convolution  method.  This  method  requires 
1.5L  multiplies  for  every  two  time  steps,  since  xw(n)  need  only  be  computed  once.  Thus,  this 
implementation  uses  0.75L  multiplies  per  time  step  on  average,  a  savings  of  0.25L  multiplies  over 
the  standard  FIR  filter  implementation.  Moreover,  storing  the  difference  terms  x(n-i)—x(n  —  i  —  1) 
in  X^(n)  reduces  the  number  of  adds  needed  to  compute  the  filter  output. 

The  above  method  can  be  extended  to  compute  a  block  of  N  output  signals.  In  active  noise 
control,  however,  it  is  important  not  to  introduce  any  output  latency,  which  typically  reduces  the 
performance  of  the  controller  for  broadband  noise  sources.  Since  all  values  used  to  compute  y(n  —  1) 
are  available  at  time  n  —  1  in  the  above  method,  it  may  be  implemented  in  a  sequential  way  without 
introducing  any  output  latency.  For  this  reason,  we  focus  on  the  block-of-two  case  in  this  paper. 
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2.2  Fast  Convolution  for  Gradient  Adaptive  Filters 


When  W(n)  is  time- varying,  the  coefficient  updates  must  be  included  within  the  above  calculations. 
For  all  of  the  algorithms  considered  in  this  paper,  the  update  for  W  (n)  has  the  form 


W(n  +  1)  =  W(n)  —  5(n)A(n),  (9) 

where  S(n)  is  an  error  signal  and  A(n)  is  a  regressor  vector.  Write  (1)  and  (9)  at  time  n  —  1  as 

W(n)  =  W(n  -  1)  -  5{n  -  1)  A(n  -  1)  (10) 

y(n  —  1)  =  XT(n-l)W(n-l).  (11) 

Substituting  W(n)  in  (10)  into  (1),  we  obtain 

y(n)  =  Xr(n)W(n-l)-<i(n-l)r'lA(n),  (12) 

where  we  have  defined 

rxA(n)  =  XT(n)  A(n  —  1)  .  (13) 


Considering  two  successive  output  samples,  we  can  write 

W(n  -  1)  - 


y(n  -  1) 

'  Xr(n  -  1)  ' 

_  yW 

.  XT(n) 

0 


(14) 


d(n  -  l)rlA(n) 

The  first  term  on  the  RHS  of  (14)  has  the  same  form  as  that  in  (3),  and  as  such,  (6)-(7)  can  be 
used  to  compute  it  with  W  =  W(n  —  1).  In  addition,  the  sliding-window  nature  of  rxA(n)  for 
gradient-based  updates  can  be  used  to  simplify  its  calculation,  as  will  be  shown. 


2.3  Fast  Updating  of  Gradient  Adaptive  FIR  Filters 

In  [23],  a  method  for  calculating  the  outputs  and  updates  for  the  LMS  adaptive  filter  in  a  block 
fashion  is  described.  Here,  we  generalize  this  result.  Two  successive  iterations  of  (9)  are  written  as 


W(n  +  1)  =  (W(n  —  1)  —  5(n  —  l)A(n  —  1))  —  £(n)A(n),  (15) 


or,  equivalently, 


'  W0(n  +  1)  ' 

’  Wo(n-l)  ‘ 

A s{n  -  1)  -  A /\{n)S(n) 

_  Wi(n  +  1)  _ 

_  Wi(n-l)  _ 

A s{n  -  1)  +  A A(n  -  l)6{n  -  1) 

where  we  have  defined 


(16) 


A  A(n)  —  A  (n  —  1)  —  A(n) 

A s{n)  =  A(n)(6(n)  +  5(n  +  1))  , 
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(17) 

(18) 


and  A (n)  contains  every  other  sample  of  the  regressor  vector  A(n).  As  the  L/2-element  vector 
A<j(n)  is  common  to  both  block  update  rows  in  (16),  it  need  only  be  computed  once.  Thus,  (16)- 
(18)  requires  about  1.5 A  multiplies  per  two  time  steps,  or  about  0.75L  multiplies  on  average  at 
each  time  step,  a  savings  of  0.25L  multiplies  over  the  standard  implementation. 

In  the  next  section,  we  apply  these  general  methods  to  five  different  ANC  algorithms. 

3  Fast  Exact  ANC  Algorithms 

3.1  Filtered-X  LMS  Algorithm 

The  most  popular  algorithm  for  active  noise  control  systems  is  the  filtered-X  LMS  algorithm  shown 
in  Figure  2.  In  this  system,  the  shaded  block  represents  the  physical  transfer  function  from  the 
output  actuator  to  the  error  sensor,  and  the  remaining  blocks  represent  the  computations  performed 
by  the  controller.  The  coefficient  updates  are  given  by 

W(n  +  1)  =  W(n)  -  ji(n)e(n)F(n)  ,  (19) 

where  W(n)  and  e(n)  are  defined  as  previously,  F(n)  =  [/(n)  •  •  •  f(n  —  L  +  l)]r  contains  the  L 
most-recent  samples  of  the  filtered  input  signal,  and  y(n)  is  the  step  size  at  time  n.  In  this  system, 
/(n)  is  computed  as 

f(n)  =  H TX(n  -  1),  (20) 

where  X(n— 1)  =  [x{n- 1)  •  •  •  x(n— M)]T  contains  M  samples  of  the  input  signal.  The  output  of  the 
controller  is  computed  as  in  (1).  Considering  (1),  (19),  and  (20),  we  find  that  this  algorithm  requires 
2-L+M  +  l  multiplies  and  2L+M  —  2  adds  per  time  step,  and  it  employs  2L  +  M +ma.x(L,  M-f-l)+3 
memory  locations  within  the  controller. 

We  now  extend  the  fast  methods  of  Section  2  to  derive  a  fast  exact  implementation  of  the 
filtered-X  LMS  algorithm.  First,  we  notice  that  the  equation  for  computing  y(n )  is  identical  in 
form  to  that  in  (12).  Thus,  (14)  becomes 

I/O* -1)1  _  iw(n-l)  +  X|(n-l)Wi(n-l)  1  _  [  0  1  f2n 

_  V(n)  J  [  xw(n  -  1)  -  X^(n)W0(n  -  1)  J  y{n  -  1  )e(n  -  l)rx/(n)  J  ’ 

with 


W,(n) 

=  [wi{n)  W2+i{n)  •••  iyL_2+i(n)]T 

(22) 

xw(n) 

=  XT(n)(W0(n)+Wi(n)) 

(23) 

rxf(n) 

=  Xr(n)F(n-l). 

(24) 
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To  compute  rxf(n)  in  an  efficient  manner,  we  note  that 

L 

rxf(n )  =  '*Tx(n-i)f(n-i-l)  (25) 

2=0 

=  rxf{n-2)+AXf(n)-Axf(n-L),  (26) 

where  Axf(n)  =  x(n)f(n  —  1)  +  x(n  —  1  )/(n  —  2). 

The  computation  of  [f(n  —  1)  f(n)]T  is  similar  to  the  original  fast  convolution  method  in  (6), 
as  H  is  fixed.  The  resulting  equations  are 


f{n  -  1) 

fW 


Xh[n  —  1)  +  XA(n  —  l)!^ 

~  T  ~ 

xh{n-l)  -XA(n) H0 


where  we  define 


XA(n) 

=  X(n  -  1)  -  X(n) 

(28) 

H  i 

=  [^1+2  ^3+2  *  '  '  hiVl— 1+i] 

(29) 

X(n  -  1) 

=  [x(n  —  1)  x(n  —  3)  •  •  ■  x(n  —  M  +  1)]T 

~  T  ~ 

(30) 

xh{n) 

=  X  (n) Ha 

(31) 

ha 

=  S0  +  Hx  . 

(32) 

A  similar  method  could  be  used  to  compute  [e(n  —  1)  e(n)]T  for  simulation  purposes;  in  practice, 
however,  e(n)  is  measured  by  the  error  sensor  and  need  not  be  computed. 

To  update  the  filter  coefficients,  we  use  a  similar  version  of  (16)  as  given  by 


W  0(n  +  1) 

_  Wi(n  +  1)  _ 

where  we  have  defined 


W0  (n  -  1) 
Wi(n-  1) 


F e(n  -  1)  -  Fi(n)fj(n)e(n) 

Fe(n  -  1)  +  FA(n  -  1  )/i(n  -  l)e(n  -  1) 


,  (33) 


F  A(n)  =  F(n  —  1)  —  F(n)  (34) 

F(n)  =  [f(n)  f(n  -  2)  •  •  ■  f(n  -  L  +  2)f  (35) 

F£(n)  =  F(n)(/i(n)e(n)  +  /^(n  +  l)e(n  +  1))  .  (36) 

Table  2  list  the  equations  for  the  fast  exact  implementation  of  the  filtered-X  LMS  algorithm 
along  with  the  number  of  multiplies  and  adds  needed  for  each  step.  In  the  table,  a  horizontal  line 
separates  the  operations  necessary  at  each  time  step;  however,  it  is  possible  to  shift  some  of  the 
calculations  from  the  second  half  of  the  block  to  the  first  half  to  balance  the  computational  load  of 
the  algorithm  at  each  sample  time.  This  algorithm  requires  ZL  +  1.5M  +  7  multiplies,  4L  +  1.5M  4-8 
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adds,  and  2.51-  +  1.5 M  +  1.5max(i,  M  +  1)  +  14  memory  locations  per  two  sample  times.  Thus, 
the  maximum  number  of  multiplies  per  sample  time  is  approximately  1.51-  +  0.75M  +  4,  which 
represents  a  savings  of  approximately  25%  over  that  of  the  original  implementation. 

3.2  Modified  Filtered-X  LMS  Algorithm 

One  drawback  of  the  filtered-X  LMS  algorithm  is  that  the  error  signal  e(n)  depends  on  past  values 
of  y(n),  which  in  turn  depend  on  past  values  of  W(n).  Since  past  controller  coefficients  appear  in 
the  error  signal,  the  adaptation  performance  of  this  system  is  worse  than  that  of  an  algorithm  with 
no  such  coefficient  delays  [16].  A  method  to  effectively  remove  these  delays  within  the  filtered-X 
LMS  updates  is  described  in  [13].  This  modified  filtered-X  LMS  algorithm  is  shown  in  Figure  3,  in 
which  a  modified  error  signal  e(n)  is  calculated  as 

e(n)  =  e(n)  -  HrY(n  -  1)  +  Fr(n)W(n),  (37) 

where  y(n)  and  /(n)  are  computed  as  in  (1)  and  (20),  respectively.  The  coefficients  of  the  controller 
are  then  updated  using  the  LMS  algorithm  as 

W(n  +  1)  =  W(n)  -  p(n)e(n)F(n)  .  (38) 

If  the  coefficients  in  the  secondary  path  model  H  are  accurate,  then  this  system’s  adaptation 
behavior  is  similar  to  that  of  an  LMS  adaptive  filter  with  input  signal  f(n)  and  desired  response 
signal  d(n).  The  complete  algorithm  requires  3 L  -I-  2 M  +  1  multiplies,  3 L  4-  2 M  -  2  adds,  and 
2 L  +  2 M  +  max(L,  M  +  1)  +  3  memory  locations  per  iteration  to  implement. 

We  now  derive  a  fast  exact  implementation  of  the  fast  modified  filtered-X  LMS  algorithm  that 
is  similar  to  that  of  the  filtered-X  LMS  algorithm  in  Section  3.1.  In  fact,  the  equations  for  y(n), 
rxf(n ),  and  /(n)  are  the  same  as  those  for  the  filtered-X  LMS  algorithm  as  given  in  equations 
(21)-(23),  (26),  and  (27)-(32)  respectively.  Moreover,  given  [e(n  —  1)  e(n)]T,  the  updates  for  W(ti) 
are  similar  to  those  in  (33)-(36)  and  are  given  by 

W0(n  +  1)  1  =  [  W0(n- 1)  1  _  T  Fe(n- 1) -FA(nV(n)e(n) 

Wi(n  +  1)  J  ~  Wi(n  —  1)  J  Fe(n  -  1)  +FA(n-  l)M(n  -  l)e(n  -  1) 

where  Fe(n)  =  F (n)(n(n)e(n)  +  /j,(n  +  l)e(n  -I- 1)). 

In  this  algorithm,  additional  computations  are  required  to  compute  e(n)  in  a  block  fashion.  We 
can  express  [e(n  -  1)  e(n)]T  as 

‘  e(n  -  1)  1  =  e(n  -  1)  1  _  [  Y T(n  -  2)H  1  [  Fr(n  -  l)W(n  -  1) 

e(n)  J  “  [  e(n)  j  [  Yr(n  -  1)H  j  +  [  FT(n)W(n) 
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(40) 


The  second  term  on  the  RHS  of  (40)  is  similar  to  (3),  and  thus  it  can  be  put  in  a  form  similar  to 
(6).  Finally,  the  last  term  on  the  RHS  of  (40)  can  be  computed  in  a  fashion  similar  to  that  used  to 
compute  y(n),  except  that  the  filtered  input  signal  f(n )  is  used  instead  of  the  input  signal  x(n)  in 
the  calculations.  Thus,  the  resulting  computations  for  [e(n  —  1)  e(n)]T  axe 

e(n  -  1)  _  e(n  -  1)  _  yh(n  -  2)  +  Y^(n  -  2)Hj 

.  J  L  e(n)  J  [  Vh(n  -  2)  -  YTA(n  -  1)H0  _ 

[  1  _  f  0  1 

fw{n-  1)  -F£(n)W0(n-  1)  J  [  y{n  -  l)e(n  -  l)rff{n)  \{ 


where 

Y  A(n)  =  Y(n-1)-Y(n)  (42) 

Vh(n)  =  YT(n)(H0  4-Hi)  (43) 

Y  (n)  =  [y(n)  y{n  -  2)  ■■■  y(n-  M  +  2}T  (44) 

fw(n)  =  Fr(n)(W0(n)  +  Wi(n))  (45) 

rff(n)  =  rff(n-2)  +  Aff(n)  -Aff(n-L)  (46) 

A//(n)  =  /(n)/(n-l)+/(n-l)/(n-2).  (47) 


Note  that  equation  (41)  assumes  that  e(n  —  1)  is  computed  before  e(n),  so  e(n  —  1)  can  be  used  in 
the  last  term  on  the  RHS  of  (41). 

Table  3  lists  the  equations  and  the  number  of  operations  needed  by  the  fast  modified  filtered-X 
LMS  algorithm  for  two  time  steps.  This  algorithm  requires  4.5L-f  3M  + 12  multiplies,  6T4-3M4- 17 
adds,  and  2.5L  4*  3 M  4-  1.5max(L,  M  +  1)  4-  15  memory  locations  for  two  time  steps.  With  proper 
partitioning  of  the  operations  over  successive  time  samples,  it  uses  at  most  2.25T  4-  1.5M  4-  6 
multiplies  at  each  time  step,  which  represents  a  savings  of  roughly  25%  over  that  of  the  original 
implementation. 

3,3  Efficient  Modified  Filtered-X  LMS  Algorithm 

If  the  output  actuator  of  the  controller  is  located  near  the  error  sensor  and  the  acoustic  plant  is  not 
overly-resonant,  then  the  filter  length  M  of  the  secondary  path  impulse  response  H  can  be  chosen 
to  be  much  less  than  the  filter  length  L  of  the  controller.  In  situations  where  L  >  3 M,  the  modified 
filtered-X  LMS  algorithm  can  be  placed  in  an  alternate  form  that  is  more  computationally-efficient 
than  that  of  the  original  [20].  This  efficient  modified  filtered-X  LMS  algorithm  employs  a  different 
method  for  calculating  e(n)  in  (37),  as  given  by 

e(n)  =  e(n)  +HTU(n  —  1) 
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(48) 


(49) 

(50) 


U(n)  =  u(n°-l)  -B,xf(n)n(n)e(n) 

R xf(n)  =  Rxf(n-1)+X(n)f(n)-X(n-L)f{n-L), 

where  U(n)  and  (n  —  1)  are  M-dimensional  vectors  and  U(n  -  1)  contains  the  first  M  —  1 
elements  of  U(n  —  1).  All  other  quantities  are  calculated  as  in  the  original  modified  filtered-X  LMS 
algorithm  in  (1),  (20),  and  (38).  This  algorithm  requires  2 L  +  5 M  +  1  multiplies,  2 L  +  5 M  —  2 
adds,  and  3 L  +  3 M  +  4  memory  locations  at  each  sample  time  to  implement. 

We  now  derive  a  fast  exact  implementation  of  the  efficient  modified  filtered-X  LMS  algorithm. 
This  implementation  computes  /(n),  y(n),  and  W(n)  as  in  the  fast  modified  filtered-X  LMS  algo¬ 
rithm.  Only  the  calculations  for  e(n)  are  different  and  are  given  by 

e(n-l)  _  e(n  -  1)  Uh{n  -  1)  4-  (Uf(n  -  2)  -  U^n  -  2))H! 

_  e(n)  J  ~  [  e(n)  j  [  uh{n  -  1)  -  {V? (n  -  2)  -  (n  -  2))H0  _ 

0 

rff{n  -  1  )/j,{n  -  l)e(n  -  1) 

where 


r/f(n  -  1)  =  HTRx/(n  -  1)  (52) 

uh(n)  =  U^n-lKHo  +  HO  (53) 

U2(n)  =  [ui(n)  ui+2(n)  -  •  •  ul+M-2{n)\T  ,  (54) 

Ui(n )  is  the  (i  +  l)th  element  of  U(n),  and  Uj(n)  =  0  for  i  <  0.  Moreover,  cy/(n)  is  computed  as 

L- 1  L- i 

rff(n)  =  ^HrX(n-t-l)/(n-i-l)  =  ^Z/(n-?)/(n-i-l)  (55) 

1=0  i=0 

r//(n)  =  rff(n  -  1)  +  f{n)f{n  -  1)  -  /(n  -  L)f(n  -  L  -  1).  (56) 

The  updates  for  U(n)  and  ^/(n)  in  this  fast  exact  version  are  the  same  as  in  (49)  and  (50)  and 


are  performed  twice  per  block.  Table  4  lists  the  operations  for  the  fast  exact  implementation  of 
the  efficient  modified  filtered-X  LMS  algorithm.  The  version  employs  3 L  +  9 M  +  12  multiplies, 
4L  4-  9.5M  +  14  adds,  and  4 L  +  5 M  +  16  memory  locations  for  two  time  steps.  Thus,  the  algorithm 
requires  approximately  1.5 L  +  4.5M  +  6  multiplies  at  each  sample  time,  which  represents  a  savings 
of  0.5(L  +  M)  multiplies  per  sample  time  as  compared  to  that  of  the  original  implementation. 

3.4  Periodic  Filtered-X  LMS  Algorithm 

In  some  situations,  the  reductions  in  complexity  provided  by  the  previously-described  methods  may 
not  be  sufficient  to  allow  the  chosen  algorithm  to  be  implemented  on  a  given  hardware  platform.  In 
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these  situations,  it  is  reasonable  to  consider  alternative  algorithms  that  sacrifice  some  adaptation 
performance  while  reducing  the  system’s  implementation  complexity.  The  periodic  filtered-X  LMS 
algorithm  is  one  such  algorithm,  in  which  every  IVth  error  signal  e(n)  is  used  to  adjust  the  controller 
coefficients  [19].  The  block  diagram  for  this  algorithm  is  the  same  as  that  in  Figure  2,  and  the 
coefficient  updates  are 


Wi(n  + 1) 


Wi{n)  -  fj,(l)e(l)f(n  -  i  +  1) 
k  m(n) 


if  (n  4-  i)modlV  =  0 
and  l  —  N  mod (n/N) 
otherwise 


(57) 


This  algorithm  updates  L/N  coefficients  at  each  time  step;  thus,  after  N  time  instants,  all  coeffi¬ 
cients  have  been  updated  using  the  same  error  signal.  All  other  equations  for  this  scheme  are  the 
same  as  that  for  the  filtered-X  LMS  algorithm.  For  N  =  2,  this  algorithm  requires  1.5  L  +  M  - hi 
multiplies,  1.5 L  +  M  —  2  adds,  and  2 L  +  M  +  ma x(L,  M  +  1)  +  3  memory  locations  per  time  step. 

We  now  describe  a  fast  exact  implementation  of  the  periodic  filtered-X  LMS  algorithm  for  the 
choice  N  =  2.  The  coefficient  updates  over  two  time  instants  are  given  by 


W(n  +  1)  =  W(n  —  1)  —  fJb{n  —  l)e(n  —  l)F(n  —  1). 


(58) 


In  addition,  the  correlation  term  rxf(n)  has  a  two-time-step  recursion  as 

rx/{n)  =  rxf{n  -  2)  +  x{n  -  l)/(n  -  2)  -  x(n  -  L  -  l)/(n  -  L  -2).  (59) 

The  remaining  equations  are  the  same  as  those  of  the  fast  exact  filtered-X  LMS  algorithm  of 
Section  3.1,  except  that  the  calculations  for  F ^(n  —  i)  and  F e(n  —  i)  are  not  required.  Table  5  lists 
the  equations  and  number  of  operations  for  this  algorithm.  The  algorithm  requires  2.5L  +  1.5M  +  4 
multiplies  and  3 L  +  1.5M  +  3  adds  per  two  time  steps  and  uses  3 L  +  1.5M  +  1.5max(L,  M  +  1)  +  3 
memory  locations.  With  proper  partitioning,  1.25L  4-  0.75M  +  2  multiplies  per  time  step  are 
required,  which  is  a  savings  of  0.25(L  +  M)  multiplies  over  the  original  implementation. 


3.5  Sequential  Filtered-X  LMS  Algorithm 


While  the  periodic  filtered-X  LMS  algorithm  updates  only  L/N  coefficients  at  each  iteration,  it  uses 
every  filtered  input  signal  /(n),  such  that  the  computational  overhead  associated  with  filtering  the 
input  signal  by  H  is  not  reduced.  The  sequential  filtered-X  LMS  algorithm  described  in  [19]  uses 
every  Nth  value  of  the  filtered  input  sequence  and  has  similar  performance  to  the  periodic  filtered-X 
LMS  algorithm  in  active  noise  control  applications.  The  coefficient  updates  for  this  algorithm  are 


Wi(n  +  1)  = 


Wi(n)  —  fj,(n)e(n)f(n  —  i  +  1)  if  (n  —  i  T  l)modiV  =  0 
Wi(n)  otherwise 


(60) 
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(61) 


For  the  choice  N  =  2,  the  updates  can  be  rewritten  as 


'  W0(n  +  1)  ' 

’  W0  (n  -  1)  ‘ 

/j,(n  -  1  )e(n  -  l)F(n  —  1) 

_  Wi(n  +  1)  _ 

Wj(n-l) 

n(n)e(n)F(n  —  1) 

and  y(n)  is  computed  using  (1).  This  algorithm  requires  1.5L  4-  0.5 M  +  1  multiplies  and  1.5 L  4- 
0.5M  —  1  adds  at  each  time  step  and  uses  uses  2 L  4-  0.5M  4-  max(L,  M  +  1)4-3  memory  locations. 

We  now  state  the  fast  exact  version  of  the  sequential  filtered-X  LMS  algorithm.  In  this  case, 
the  fast  convolution  technique  is  only  applied  to  the  input-output  controller  calculation,  and  the 
calculations  associated  with  computing  f(n)  for  even  time  instants  can  be  removed.  Table  6  shows 
the  operations  for  this  version  of  the  algorithm.  It  requires  2.5L  +  M  +  5  multiplies,  3L4-M4-3  adds, 
and  2 L  4-  1.5M  +  1.5max(L,  M  4*  1)4-11  memory  locations  to  implement  for  two  time  steps.  Thus, 
the  average  number  of  multiplies  per  time  step  is  1.25L  4-  0.5 M  4-  3,  a  savings  of  approximately 
0.25L  multiplies  over  the  original  implementation. 

3.6  Summary 

In  summary,  we  have  derived  new  implementations  of  several  existing  algorithms  for  feedforward 
active  noise  control.  Table  7  summarizes  the  number  of  multiplies,  adds,  and  memory  locations  for 
the  standard  and  fast  exact  implementations  of  the  algorithms.  Our  results  indicate  that  the  fast 
exact  techniques  are  effective  in  reducing  the  complexities  of  these  algorithms,  and  up  to  a  25% 
reduction  in  number  of  multiplies  can  be  achieved  in  some  cases. 

4  Implementation  Issues 

Although  reductions  in  the  number  of  multiplies  and/or  adds  are  an  indication  of  a  new  al¬ 
gorithm’s  computational  efficiency,  such  reductions  may  not  translate  to  a  more-efficient  real-time 
implementation  on  a  chosen  hardware  platform.  To  accurately  gauge  such  issues,  one  must  con¬ 
sider  the  freedoms  and  constraints  that  a  particular  hardware  platform  might  impose  on  a  controller 
implementation,  such  as  memory  access,  parallel  operations,  allowable  operations,  and  load  bal¬ 
ancing.  By  implementing  an  algorithm  on  a  chosen  hardware  platform,  we  assess  an  algorithm’s 
compatibility  to  the  hardware  architecture. 

In  this  section,  we  describe  real-time  implementations  of  the  standard  and  fast  exact  versions  of 
the  filtered-X  LMS  algorithm  on  the  Motorola  DSP96002  floating-point  processor  running  at  33MHz 
and  sampling  at  8kHz.  The  architecture  of  the  Motorola  DSP96002  DSP  platform  is  similar  to  those 
of  other  DSPs  that  support  parallel  operations.  The  processor  has  three  partitioned  independently- 
accessible  memory  spaces,  ten  floating  point  data  registers,  and  eight  address  registers  that  allow  for 
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circular  addressing  and  hardware-controlled  loops.  For  a  complete  description  of  this  processor,  see 
[24,  25].  In  addition,  in  order  to  allow  simple  complexity  comparisons  without  radical  modifications 
of  the  hand-tuned  software  code,  we  chose  to  fix  the  value  of  M  —  Lj 2  so  that  only  one  parameter 
(L)  controls  the  overall  complexity  of  the  system.  This  choice  is  somewhat  arbitrary  but  is  not 
atypical  for  broadband  noise  control  applications. 

4.1  Software  Implementation 


All  vectors  calculations  were  implemented  using  circular  buffers  as  supported  by  the  DSP  hardware. 
The  block-of-two  tilde  vectors  were  accessed  by  incrementing  through  a  given  data  vector  array 
using  a  skip  value  of  two.  Traversing  of  a  circular  buffer  by  an  arbitrary  skip  value  is  supported 
by  the  DSP96002  by  use  of  modifier  registers  and  is  equivalent  in  complexity  to  traversing  with  a 
skip  value  of  one. 

One  major  issue  that  must  be  addressed  in  many  real-time  DSP  implementations  is  the  num¬ 
ber  and  type  of  memory  accesses  required  by  an  algorithm.  This  issue  has  not  been  previously 
considered  in  this  paper,  and  it  can  affect  the  ease  with  which  an  algorithm  is  implemented. 

In  order  to  identify  portions  of  the  algorithms  that  may  be  memory-access-limited,  we  used  the 
following  simple  method  to  estimate  the  effect  that  memory  accesses  might  have  on  the  efficiency 
of  a  given  loop  within  an  algorithm.  Assume  that  memory  accesses  are  the  limiting  factor  in 
implementation  speed,  and  ignore  any  data  dependencies  that  may  exist  within  a  loop’s  equations. 
Noting  that  each  DSP  instruction  takes  a  constant  time  period  to  complete,  the  time  required  to 
calculate  a  given  equation  is  proportional  to  the  number  of  instructions  needed  to  implement  it. 
So,  the  minimum  total  number  of  instructions  required  to  implement  any  given  loop  is 

m  ,  .  „  .  r  ,  #  of  Memory  Locations  Accessed  .  x 

Minimum  Total  #  of  Instructions  =  — - - — — - — ^ - .  (62) 

Max.  #  of  Parallel  Accesses  per  Instruction 

The  minimum  number  of  instructions  within  a  loop  that  is  required  to  implement  a  particular 
equation  is  given  by 


Minimum  #  of  Instructions  In  Loop 


#  of  Different  Vectors 
Max.  #  of  Parallel  Accesses  per  Instruction 


,(63) 


where  |\]  is  the  ceiling  operation. 

As  an  example,  to  calculate  y(n)  =  Xr(n)W(n),  we  need  to  access  2 L  quantities  using  a 
processor  that  allows  at  most  2  data  memory  locations  to  be  accessed  by  one  instruction.  Thus, 
at  least  2L/2  —  L  instructions  are  required  to  implement  this  operation  on  this  processor.  Since 
two  different  vectors  are  being  accessed,  we  require  a  loop  containing  at  least  2/2  =  1  instruction 
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within  it  to  implement  this  operation.  Such  an  implementation  is  the  most  computationally-efficient 
one  for  this  operation,  which  is  to  be  expected  given  the  processor  design  choices  made  by  most 
manufacturers  of  DSP  platforms. 

Using  this  methodology,  we  determined  which  portions  of  the  standard  and  fast  exact  filtered-X 
LMS  algorithm  would  likely  be  memory-access-lirnited.  For  the  standard  filtered-X  LMS  algorithm, 
only  the  coefficient  update  portion  of  the  algorithm  was  found  to  be  memory-access-limited,  re¬ 
quiring  two  instructions  per  loop  iteration  to  perform  the  three  memory  accesses  of  1)  reading  an 
element  of  F(n),  2)  reading  an  element  of  W(n),  and  3)  writing  an  element  of  W(n).  This  situation 
is  not  uncommon  for  DSP  implementations  of  LMS  adaptive  FIR  filters  on  other  processors  [26] 
and  is  typically  the  most-efficient  method  for  implementing  a  gradient-based  update.  For  the  fast 
exact  version,  the  calculation  of  xw{n)  in  (7),  the  coefficient  updates  in  (33),  and  the  calculation  of 
Fe(n)  in  (36)  were  all  found  to  be  memory- access-limited  in  their  original  form.  To  simplify  their 
implementation,  we  computed  the  vector  W^fn)  =  Wo(n)  +  W i(n)  within  the  coefficient  update 
loop  and  used  this  vector  to  compute  xw(n)  in  one  L/2-length  loop.  In  addition,  while  (33)  could 
be  broken  up  into  several  different  loops  of  length  L/ 2,  we  chose  to  implement  this  equation  in 
one  L/2-length  loop  containing  six  instructions,  as  this  minimizes  the  number  of  filter  coefficient 
read/writes,  makes  the  most-efficient  use  of  the  DSP96002’s  processor  units,  and  preserves  the 
complexity  advantages  provided  by  the  fast  exact  implementation. 

As  mentioned  previously,  the  fast  exact  algorithms  in  Tables  2-6  require  more  operations  in 
the  second  time  step  than  the  first.  To  achieve  the  most-efficient  implementation  on  a  platform 
dedicated  to  the  ANC  task,  one  must  balance  the  number  of  instructions  required  at  each  time  step 
by  moving  computations  from  the  more  heavily-loaded  time  step  to  the  less  heavily-loaded  time 
step.  In  addition,  only  portions  of  the  algorithm  that  do  not  depend  on  current  signal  values  can  be 
moved  in  this  way  if  causality  is  to  be  preserved.  In  our  code,  a  portion  of  the  coefficient  updates 
for  the  fast  exact  filtered-X  LMS  algorithm  at  time  (n- 1-1)  were  moved  to  a  position  in  the  first  half 
of  the  next  (n  +  2)  time  step  that  was  prior  to  the  use  of  any  of  the  elements  of  W(n  4- 1).  Such  a 
partitioning  depends  on  the  relative  values  of  L  and  M  in  general,  which  is  one  of  the  reasons  why 
the  choice  M  =  L/2  was  made  at  the  onset  of  code  development. 

4.2  Experiments 

Using  the  methodology  outlined  above,  both  the  standard  and  fast  exact  versions  of  the  filtered- 
X  LMS  algorithm  were  implemented  on  the  DSP96002.  Tests  were  then  run  to  verify  that  both 
algorithms  performed  identically  for  a  given  value  of  L  and  to  compare  the  maximum  value  of  L 
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that  each  version  would  allow  for  the  given  clock  and  sampling  rates. 

First,  the  two  implementations  were  tested  for  equivalence.  Two  sequences  x(n)  and  e(n),  each 
fifty  samples  long  as  shown  in  Figure  4,  were  stored  within  the  processor  for  use  by  both  algorithms. 
Both  algorithms  were  then  applied  to  this  data  with  y,(n)  =  0.01  and  L  —  10.  Shown  in  Figure  5 
are  the  sequences  y(n),  /(n),  and  the  first  coefficient  wo(n)  for  both  the  standard  and  fast  exact 
versions,  in  which  the  sample-by-sample  equivalence  between  the  two  algorithm’s  outputs  can  be 
readily  seen.  Here,  we  have  only  plotted  the  value  of  wq(ti)  for  even  time  steps,  as  the  fast  exact 
version  does  not  calculate  a  value  for  wo(n)  at  every  time  step.  These  results  indicate  that  that 
two  implementations  are  mathematically-equivalent. 

We  then  ran  both  algorithms  in  a  real-time  setting,  in  which  a  loudspeaker  generating  several 
sinusoids  of  different  amplitudes  and  frequencies  between  100  and  350Hz  was  used  as  the  noise¬ 
generating  device.  A  reference  signal  obtained  from  a  microphone  in  front  of  this  loudspeaker  was 
sampled  and  used  by  the  processor  as  the  input  signal  x(n),  and  the  output  signal  y(n)  was  sent 
to  a  second  loudspeaker  placed  approximately  1.0m  in  front  of  the  noise  source.  A  microphone 
placed  approximately  0.5m  in  front  of  the  secondary  loudspeaker  provided  the  error  signal  e(n), 
and  the  secondary  path  impulse  response  H  was  identified  using  a  second  LMS-based  identification 
procedure  prior  to  the  experiment.  Both  the  standard  and  fast  exact  versions  of  the  filtered- 
X  LMS  algorithm  were  found  to  produce  audiably-indistinguishable  cancellation  behavior  at  the 
error  microphone  for  all  step  sizes  values  and  filter  lengths  chosen. 

Next,  the  algorithms  were  tested  to  determine  the  maximum  value  of  L  that  both  versions 
would  allow  before  the  processor  capabilities  were  exceeded  at  the  chosen  8kHz  sample  rate.  It 
was  found  that  the  standard  implementation  enabled  a  controller  filter  length  of  Ls  =  672  without 
failure,  whereas  the  fast  exact  implementation  allowed  a  value  of  Lf  =  856,  a  27.4%  increase. 
If  number  of  multiplies  were  a  true  indicator  of  algorithm  complexity,  we  would  expect  a  33.3% 
increase  given  our  previous  results  (i.e.,  1/0.75  =  1.333);  however,  such  conservative  estimates 
ignore  important  factors  such  as  1)  the  overhead  associated  with  any  out-of-loop  instructions  and 
2)  the  non-constant- time  nature  of  some  input /output  fetching  instructions. 

If  we  assume  that  each  instruction  takes  a  constant  time  to  execute,  which  is  correct  for  all 
parallel  instructions,  we  can  count  the  number  of  instructions  in  the  code  to  estimate  overhead 
effects.  The  standard  implementation  contains  17  +  3.5 Ls  +  k  instructions  per  time  step,  where  k  is 
the  number  of  instructions  common  to  both  the  standard  and  fast  exact  code  and  Ls  is  the  value  of 
L  for  the  standard  implementation.  The  fast  exact  code  contains  a  maximum  of  108  +  2.625L j  4-  k 
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instructions  per  time  step,  where  Lf  is  the  value  of  L  for  the  fast  exact  version.  Both  algorithms 
have  the  maximum  allowable  filter  lengths  with  equal  numbers  of  instructions,  or 

17  +  3.5  Ls  +  k  =  108  +  2.625L/  +  A;.  (64) 

After  some  rearrangement,  we  have 


The  last  term  in  (65)  depicts  the  detrimental  effects  of  overhead  on  the  computational  performance 
of  the  fast  exact  version.  Note  that  if  this  term  is  ignored,  we  obtain  Lf  =  1.333£s,  as  expected. 
Moreover,  if  we  set  Ls  =  672,  we  find  from  (65)  a  predicted  value  of  Lf  =  861,  close  to  the  actual 
value  of  Lf  =  856  observed.  The  difference  is  likely  caused  by  the  few  instructions  for  which  the 
constant  instruction  execution  time  assumption  is  not  valid. 

5  Conclusions 

This  paper  describes  extensions  of  the  fast  exact  LMS  adaptive  algorithm  to  five  different 
algorithms  for  single-channel  feedforward  active  noise  control.  Savings  of  up  to  25%  in  the  number 
of  multiplies  can  be  realized  with  these  implementations  without  any  algebraic  change  to  each 
algorithm’s  inherent  input-output  behavior.  The  computational  savings  could  allow  the  systems  to 
be  implemented  on  less  expensive  hardware,  to  free  up  some  processor  cycles  for  other  operations, 
or  to  allow  the  implementation  of  longer  filter  lengths  on  a  chosen  processor.  Where  there  exist 
portions  of  the  algorithms  for  which  the  block  techniques  are  not  applicable,  then  the  savings  in 
number  of  multiplies  is  less  than  25%. 

Real-time  experiments  with  coded  versions  of  the  standard  and  fast  exact  filtered-X  LMS  algo¬ 
rithm  on  the  Motorola  DSP96002  DSP  processor  indicate  that  the  latter  is  more  efficient  than  the 
former  on  this  processor,  as  the  latter  allows  maximum  filter  lengths  that  are  nearly  one-third  longer 
than  those  allowed  for  the  former  at  the  same  clock  and  sampling  rates.  The  implementations  also 
illustrate  the  important  issues  of  memory  access  and  load  balancing  that  must  be  considered  when 
efficiently  implementing  these  algorithms  on  a  typical  DSP  platform.  These  results  illustrate  that 
the  computational  savings  obtained  by  the  fast  exact  algorithms  can  be  obtained  in  a  real-world 
setting,  thus  verifying  their  utility  for  actual  active  noise  control  systems.  In  addition,  extensions  of 
these  algorithms  to  standard  multichannel  algorithms  for  active  noise  control  are  straightforward, 
and  the  computational  benefits  obtained  in  such  cases  can  be  expected  to  be  similar. 
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Table  1:  General  notation  used  in  this  paper. 


Notation 

Examples 

Description 

Upper  case  letters 

L  and  M 

Constants 

Lower  case  letters 

i  and  n 

Scalar  values 

Subscript  values 

Wi 

Index  of  a  set  of  scalar  values 

Signal  (index) 

x(n) 

Value  of  signal  at  a  given  time  step 

Bold  uppercase(index) 

X(n) 

Vector  of  the  last  L  values  of  a  signal 

Bold  underlined  uppercase(index) 

X(n) 

Vector  of  the  last  M  values  of  a  signal 

Bold  tilde  uppercase(index) 

X(n) 

Vector  formed  by  taking  every  other 

element  of  a  corresponding  vector 

subscript-A 

XA(n) 

The  sum  or  difference  between  vectors 

XT(n) 

i.e.,  XA(n)  =  X(n-1)-X(n) 

superscript-T 

Vector  transpose 
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Table  2:  The  fast  exact  filtered-X  LMS  algorithm. 


Table  3:  The  fast  exact  modified  filtered-X  LMS  algorithm. 
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Fe(n  -  1)  —  F(n  -  l)(eM(n  -  1)  4-  e 

m(»)) 

W0(n  +  1) 

_ 

W0(n  -  1) 

£«("  -  1)  -FA(n)e>,(n) 

.  WX  (n4-l)  . 

.  W j  (n  —  1)  . 

.  Fe(n  -  1)  4-  FA  (n  -  l)eu(n  -  X) 

0 

4 

0.5L  +  X 
0 

4 

0 

0.5L  4-0.5A*  -1-  2 
0.5L 


0 

4 

0.5L  -f  1 
0 

4 

1 

0.5L  +0.5 M  4-  3 
1 


Totals  (for  two  time  steps ) 


4.5 L  4-  3 M  4-  12 


6L4-3M4-  17 
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Table  4:  The  fast  exact  efficient  modified  filtered-X  LMS  algorithm. 


<;(n  —  1)  ~  —  lT+  H7  Y(n  -  2) 

f  x(n-2)  1 

X(n  -  1)  =  ” 

L_X(n  -  3 )J 

xH(n-l)  =XT(n-  1)HA 

x(n  —  2)  —  x(n  —  1' 


Equation 


No.  of  X  's  |  r  No.  ~~of+’s 


XA(n-l)  = 
XA(n  -  1)  = 


XA(n  -  3) 
x(n  —  3)  —  x(n  —  2) 

-  3) 


0 

0.5M 

0 


measured 

0 


/(n  -  1)  =  xh(n  -  1)  +  XA(n  -  1)^ 

r  /(n  -  1)  1 

F(n  -  1)  =  ~ 

[  F(n-3)  j 
f  /(n  —  2)  —  /(n  —  1)  1 

Fa(-1)-[  ?*(-«  j 


x(n  ~  1) 

X(n  -  3) 
x(n  —  l) 
X(n  -  2) 


X(n  —  1)  = 

X("-  1)  = 

xw(n  -  1)  «  XT(n  -  l)(W0(n  -  IJ  +  W^n  -  1)) 
y(n  -  1)  =  i„(n  -  l)  4-Xj(n  -  IJWjfn  -  l) 
uh(n  -  1)  =  Uj(n  -  l)HA 

efi(n  -  1)  =  M(n)(e(n  -  2)  _  _ 

+uh(n  -  l)  +  (Uf(n  -  2)  -  Uj(n  -  2))H,) 
Rx/(n  -  1)  =  Rc/(n  -  2)  +  X(n  -  1  )/(n  -  1)  -  X(n  -  L  -  l)/(n 

U(»-l)=[  u(„°-  2)  ] D^("-D 


0.5A/ 

0 

0 

0 


0.5M  -  1 
1 

previously  calculated 

0.5  M 
0 

1 

0 

0 


L-l) 


0.5  L 
0.5  L 
0.5  A/ 

0.5  A/  4-  1 

2  a; 

M 


L  -  1 
0.5L 

0.5 A/  -  l 

m  +  i 
2M 


«(n)  =  d(n)  4-  HJ'Y(r 
f  x(n-  1) 

X(n)  =  ~ 

X(n  -  2 


1) 


X*(n)  = 
XA(n)  = 


2) 

x(n  —  1)  —  x(n) 

XA(n  -  2) 
x(n  -  1)  -  x(n) 

X  A  ( n  —  2 )  _ 
/(n)  =  xh(n-l)  +  XA(n)H( 

L  F(n  —  2)  _ 
f/Cn-l)  -/(n) 
FA(n)  =  5= 

L  F  A  (n  —  2) 
x(n) 


X(n)  = 
X(a)  = 


■  2) 


X(n  -2) 

_*(«) 

_  X(n  -  1) 

i / (n)  =  r*/(n  -  2)  4*  x(n)/(n  -1)4-  x(n  -  l)/(n 

—  x(n  -  L)f(n  -  L  -  1)  -  x(n  -  L  -  l)/(n  —  L  —  2) 
y(n)  =  iu(n  -1)4-  Xj(n)W0(n  -  1)  -  <^(n  -  l)rx/  (n) 
e^n)  =  /i(n)(c(n)  -  eM(n  -  l)rff(n)  ^ 

4-u h(n  -  1)  -  (Uf(n  -  2)  -  Ul^n  +  2))H0 
R/a(n)  =  Rx/(n  -  1)  +  X(n)/(n)  -  Xf n  -  L)/(n  -  L) 

U(n°-1)  ]  1) 

//(«)  ="  r,/(n  -  2)  +  /(n)/(n  -1)4-  f(n  -  l)/(n  -  2) 

-f(n  -  L)f(n  —  L  —  1)  -  /(n  -  L  -  i)f(n  -  L  -  2) 
F m(n  -  1)  =  F(n  -  lK^n  -  1)  +eM(n)) 

r  — -  n  r  1  r  — ' 


U(n)  = 


0.5  A/ 

0 

0 

0 

0 

4 

0.5//  +  1 

0 . 5  A/  +  2 
2  M 

M 


measured 
0 

1 

prevtous/y  calculated 

0.5  A/ 

0 

1 


4 

0.5L 


W  0(n  +  1) 
W }  ( n  4-  1) 


W 0(n  -  1) 
W i (n  -  1) 


Fe(n  -  1)  -  FA(n)eM(n) 

F e(n  —  1)  4-FA(n  —  l)eM(n  ■ 


0 

4 

0.5A  -I-  l 

0.5  M  4*  2 
2  M 


Totals  (for  two  time  steps) 


3 L  t  9A/  4-  12  I  4 L  4-  9  5  A/  4-  14 
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Table  5:  The  fast  exact  periodic  filtered-X  LMS  algorithm. 


Equation 


e(n  -  1)  =  d(n  -  1)  +  H  X(n  ~  2) 
eM(n  -  1)  =  /x(n  -  l)e(n  -  1) 


X(n  -  1)  : 


[  ff71  ~  2) 

L  E(n-3)  J 


*fc(n-l)aX  (n-l)HA 
—  f  x(n  —  2)  —  x(n  —  1) 

XA(n  -  1)  =  — 

XA(n-3) 

~  f  x(n  —  3)  —  x(n  —  2) 

XA  (n  -  1)  =  “ 

L  2CA(n-3) 

/(n—  1)  =  X/j(«—  1)  +  XA(n  —  1)5^ 

r  /(»-D  l 

F(n-1)  =  ~ 

F(n  -  3) 


—  f  x(n  —  1) 

X(«  -  1)  =  — 

[_X(n-3)^ 

xw(n  -  X)  =XT(n  -  l)(W0(n  -  1)J-  Wx(n  -  1)) 
y(n  -  1)  =  xw(n  -  1)  +  XA(n  -  l)Wi(n  -  1) 


r  *(n  -  1  1 

X(n)  -  - 

L  X(n-2)  J 


—  x(n  • 
XA(n)=  ~ 

—  x(n  ■ 

XA(n)=[  | 


X*(n  -  2) 

n  —  1)  —  x(n) 


eM(n  -  1) 


ivo.  o/  X ’s  \  No.  of  -j-\j 


measured 

1  I  0 


previously  calculated 


L  J 

/(n)  =  xh(n-l)-XA(n)H0  0 

r  /(»)  1 

F(n)  *  =  0 

L  F(n-2)  J 
~  f  s(n)  1 

X(n)  =  ~  0 

L  X(n-  2)  J 

ra:/(n)  =  rxj  ( n  -  2)J-  x(n  -  l)/(n  -  2)  -  x(n  —  L  —  1  )/(n  —  L  —  2)  2 

y(n)  =  xw(ti  -  1)  -  Xjjn)Wo(n  -  1)  -  cM(n  -  I)rz/(n)  0 

'  W0(n  +  1)  1  =  r  Wo (»  -  1)  1  _  [  F(n  -  1)  1  („  _  1} 

.  Wi(»  +  1)  1  [  Wi(n-l)  J  [  F(n-2)  J _ 

Totals  (two  time  steps)  ~ 


previously  calculated 


2.5L  +  1.5M+4  j  3L  +  1.5A/4-3 


Table  6:  The  fast  exact  sequential  filtered-X  LMS  algorithm. 


Table  7:  Comparison  of  algorithm  complexities. 


Figure  3:  Block  diagram  of  the  modified  filtered-X  LMS  adaptive  algorithm. 


26 


Figure  4:  The  input  and  error  signals  used  in  the  first  set  of  DSP96002  experiments:  a)  x(n)  and 
b)  e(n). 
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ABSTRACT 

While  it  is  possible  to  implement  the  sliding  discrete 
Fourier  transform  (DFT)  recursively,  numerical  er¬ 
rors  accumulate  in  the  resulting  outputs.  This  pa¬ 
per  presents  a  recursive  system  whose  output  at  ev¬ 
ery  Lth  sample  time  is  equivalent  to  that  of  the  slid¬ 
ing  DFT  and  whose  numerical  errors  do  not  grow 
with  time.  We  provide  a  statistical  analysis  of  the 
numerical  performance  of  the  proposed  technique, 
showing  that  it  outperforms  a  similar  approximate 
method  employing  an  exponentially-decaying  win¬ 
dow.  When  applied  to  sliding-window-covariance 
RLS  adaptive  filters,  the  technique  mitigates  this 
system’s  error  accumulation  without  any  significant 
increase  in  complexity.  An  extension  of  the  method 
to  the  sliding  discrete  cosine  transform  (DCT)  is 
also  provided. 

1.  INTRODUCTION 

Consider  the  discrete- time  linear  time-invariant  system 
L  — 1 

y(k)  =  e~j2~m,/Lx(k  -  m),  (1) 

m= 0 

where  /  is  an  integer  in  the  range  0  <  l  <  (L  -  1).  This 
system  computes  the  lth  bin  value  of  the  sliding  discrete 
Fourier  transform  (DFT)  of  the  signal  x(k).  Such  a  system 
is  useful  in  spectral  estimation  [l]  as  well  as  in  transform- 
domain  adaptive  filtering  [2]. 

When  l  =  0,  (1)  computes  the  running  sample  aver¬ 
age  of  a  signal  across  an  L-element  window.  This  ubiq¬ 
uitous  system  is  useful  for  numerous  signal  processing  tasks 
[3]— [10] .  In  addition,  if  x(k  —  m)  represents  the  squared 
estimation  error  of  an  N- coefficient  FIR  adaptive  filter, 
the  recursive  minimization  of  y(k)  over  time  yields  differ¬ 
ent  forms  of  the  sliding-window-covariance  recursive  least- 
squares  (SWC-RLS)  adaptive  filter  [11,  12]. 

The  system  in  (1)  can  be  implemented  recursively  as 

y(k)  =  e~ji,rl/Ly(k-l)-  x(k-  L)  +  x(k).  (2) 

Such  an  implementation  is  quite  useful,  as  it  only  re¬ 
quires  a  single  (complex)  multiply  and  two  additions  per 
time  instant.  However,  this  recursive  implementation  is 

°This  material  is  based  upon  work  supported  by  the  U  S.  Army 
Research  Office  under  grant  number  D A AH04-96- 1-0085.  The  con¬ 
tent  of  the  paper  does  not  necessarily  reflect  the  position  or  the 
policy  of  the  federal  government,  and  no  official  endorsement  should 
be  inferred. 


marginally-stable,  and  thus  finite-precision  errors  will  lin¬ 
early  accumulate  in  the  value  of  y(k)  over  time.  If  left 
unchecked,  such  errors  can  make  (2)  useless.  For  this  rea¬ 
son.  the  following  approximate  system  is  proposed  [2]: 

L  —  1 

y(k)  =  ^(A e~]27rl,L)mx{k  -  m),  (3) 

m=0 

where  0  <C  A  <  1.  The  recursive  implementation  of  (3)  is 

y(k)  =  ^Xe~j2~l^L'j  y(k  —  1)  —  Aii(fc  —  L)  +  x(k),  (4) 

which  requires  two  multiplies  and  two  additions  per  time 
instant.  While  this  system  is  numerically-stable,  it  no 
longer  computes  the  exact  value  of  y(k)  in  (1),  although 

| y(k)  —  y(k)\  can  be  made  small  via  suitable  choice  of  A. 
An  alternative  solution  is  to  periodically  restart  the  cal¬ 
culation  of  y(k ).  This  method  does  not  require  additional 
multiplies,  but  it  does  require  more  additions  and  memory. 
Moreover,  the  two-tiered  coding  strategy  needed  for  the  sys¬ 
tem's  restart  is  undesirable  for  SWC-RLS  adaptive  filtering 
as  it  is  computationallv-expensive  [4]. 

When  implementing  the  sliding  DFT,  two  other  meth¬ 
ods  are  of  particular  interest.  The  LMS  spectrum  analyzer 
uses  a  variant  of  the  LMS  algorithm  to  compute  an  L-point 
sliding  DFT  [13].  While  its  complexity  is  similar  to  that  in 
(2),  simulations  in  Section  4  show  that  it  suffers  from  sim¬ 
ilar  numerical  accumulation  effects  when  implemented  in  a 
floating-point  environment,  although  its  numerical  proper¬ 
ties  in  a  fixed-point  environment  appear  to  be  better  than 
those  of  (2)  [14].  When  L  is  a  power  of  two,  the  sliding 
FFT  is  a  non-recursive  method  for  computing  an  L-point 
sliding  DFT  that  requires  O(L)  multiplies  per  time  instant 
to  implement  [15,  16].  This  system  requires  0(L\og2L) 
memory  locations,  however,  which  can  be  prohibitive  for 
some  applications. 

In  this  paper,  we  present  a  technique  that,  like  (4),  ap¬ 
proximates  the  system  in  (1)  using  a  simple  recursive  up¬ 
date.  Our  technique  is  a  periodically-time-varying  system 
designed  so  that  any  numerical  errors  introduced  by  finite- 
precision  arithmetic  at  time  k  exponentially  decay  to  zero 
over  time.  Like  (4),  the  new  method  requires  two  multi¬ 
plications  and  two  additions  at  every  time  instant.  How¬ 
ever,  unlike  (4)  in  which  y(k)  ^  y(k)  in  general,  our  tech¬ 
nique  produces  an  output  signal  that  is  mathematically- 
equivalent  to  y(k)  in  (1)  at  every  Lth  time  instant.  At 
other  time  instants,  the  difference  between  the  output  of 
the  proposed  system  and  y(k)  in  (1)  can  be  made  arbitrar¬ 
ily  small  through  the  proper  choice  of  the  leakage  param¬ 
eter  A.  Moreover,  the  new  technique  does  not  require  any 


significant  additional  memory.  An  application  of  the  new 
technique  to  SWC-RLS  adaptive  filters  shows  that  it  sta¬ 
bilizes  the  marginal  instability  of  this  system  at  almost  no 
additional  computational  cost.  We  also  provide  an  exten¬ 
sion  of  the  technique  to  the  sliding  discrete  cosine  transform 
(DCT)  useful  for  adaptive  filtering  tasks  [17]— [19]. 

2.  A  NUMERICALLY-STABLE  RECURSIVE 
SLIDING- WINDOW  ESTIMATOR 


Under  our  statistical  assumptions,  this  expression  becomes 

?  =  £A/.,.(10) 

m=  1  '  1  -  A  y 

The  variance  of  the  estimation  error  y(k)  —  y(k ),  denoted 
as  ?2,  is  given  by 


The  proposed  method  for  approximating  (1)  is  a  period¬ 
ically-time-varying  linear  system.  If  numerical  errors  are 
not  present,  the  system  is  equivalent  to 


L  — 1 

y{k)  = 

hi(k,  m)x(k 

—  m) 

(5) 

hi(k,  m)  = 

(  g  — j2irmZ/ L 

if  kmodL  >  m 

(6) 

j  ^e-j2?rmf/L 

if  kmodL  <  m 

where  x(k)  and  y(k)  are  the  input  and  output  signals  of  the 
system,  respectively,  hi(k,  m)  is  the  time-varying  impulse 
response  of  the  system,  and  0  <  A  <  1.  When  kmodL  = 
L  —  1,  y(k )  is  mathematically  the  same  as  y(k)  in  (1).  At 
other  sample  instants,  y(k)  deviates  from  y(k).  A  simple 
calculation  shows  that 


=  E{[y(k)-y(k)-ft2}  (11) 


With  our  assumptions,  the  RHS  of  (12)  is 


^r> 

<J 


L  ~  1 


1  -  A  1  -  A2  ) 


2 


(13) 


We  now  consider  the  performance  of  (4)  in  a  finite- 
precision  environment,  in  which  y(k ),  the  finite- precision 
equivalent  of  y(k),  is  approximately 


L  —  l 

\y{k)-y(k)\  <  (1  -  A)  |z(&  -  m)|,  (7) 

1 

such  that  | y(k)  —  2/(A:)|  can  be  made  arbitarily  small  by 
proper  choice  of  A. 

The  system  in  (6)  has  a  simple  recursive  implementation 
that  makes  it  a  useful  for  approximating  the  sliding  DFT: 

y(k) 

f  A [e’j2rrl/Ly(k)  -  x(k  -  L)]  +  x(k)t  if  kmodL  =  0 
[  e~j27rlt Ly{k)  —  A x(k  —  L)  +  z(fc),  otherwise. 

This  implementation  requires  two  multiplications  and  two 
additions  as  well  as  the  control  logic  to  determine  when 
kmodL  =  0.  Note  that  many  digital  signal  processors 
(DSPs)  have  built-in  circular  pointer  indexing  schemes  that 
make  such  a  test  simple  to  implement. 

3.  PERFORMANCE  ANALYSIS 


y(k)  —  Aj/(£  —  1)  —  A  z(k  —  L)  +  x(k)  -j-  fi(fc)  4*  £o(k)  (14) 

where  €i{k)  and  €0{k)  are  the  numerical  errors  associated 
with  the  first  and  second  terms,  respectively,  on  the  RHS 
of  (14).  Defining  ?(k)  as 

?(k)  =  y(k)  -  y(k),  (15) 


we  can  develop  a  recursive  equation  for  7(k)  given  by 

e(k)  =  Xc(k  —  1)  +  ct(k)  +  €0(k).  (16) 

Assuming  that  a(k)  and  e0(k)  are  zero  mean  and  i.i.d.  with 
variances  a2,  we  obtain  the  limiting  variance  of  7(k)  as 


lim  <r2(k)  =  — . 

fe-co  1-A2 


(17) 


We  now  analyze  the  performances  of  the  estimators  in 
(4)  and  (8)  in  a  statistical  framework.  For  simplicity,  we 
consider  the  case  where  l  =  0  and  x(k)  is  real- valued,  and 
we  assume  that  x(k)  is  a  stationary  uncorrelated  random 
process  with  mean  fix  and  variance  .  In  each  case,  we 
determine  three  quantities: 

•  the  average  bias  in  the  outputs  of  each  system  with 
respect  to  y(k), 

•  the  variance  of  the  difference  between  the  outputs  of 
each  system  and  y(k),  and 

•  the  variance  of  the  numerical  error  in  the  output  of 
each  system  assuming  a  standard  statistical  model  for 
the  quantization  errors. 

We  first  analyze  the  performance  of  the  system  in  (4) 
under  the  above  assumptions.  The  average  bias  of  this  es¬ 
timator  assuming  infinite  precision  calculations  is 


We  now  analyze  the  statistical  performance  of  (8)  un¬ 
der  our  assumptions.  Since  the  system  has  a  time-varying 
impulse  response,  we  consider  quantities  that  are  averaged 
over  L  sample  times  in  order  to  provide  a  fair  comparison. 
We  first  consider  the  time-averaged  bias,  denoted  as 


A t  = 


k 

2  £{»(”)-»(»)}  (18> 

n=fc  — L-f  1 


n=k-L-\- 


E 


i 


L  —  1 

y  ^(1  —  ho  (b,  m))x(n  —  m) 

m=0 


Employing  (6),  we  can  simply  the  above  expression  as 


L-l 


?  =  E{y(k)  -  y(k)}  =  £  <  XA1  -  ^x(k  ~ 


(9) 


-X)mns  =  (20) 


2 


Table  1:  Comparison  of  numerical  performance,  exponentially- windowed  and  new  schemes,  l  —  0, 


Window 

L 

Param 

1- A 

tier 

1  -  A 

. “Hi 

as 

Error  l 

Variance 

Precision 
a\ (oo) 

. ikil_ 

10 

1.81  X  10-* 

0.01 

8.11  x  10"3 

4.50  x  lO-3 

9.24  x  10”° 

4.50  X  10“° 

55.3 

100 

1.97  x  10~4 

0.01 

9.69  x  10-3 

4.95  X  10~3 

1.26  x  10"4 

4.95  X  10“s 

50.8 

— *  oo 

—  0 

0.01 

9.89  x  10“3 

5  x  10-3 

1.30  x  lO"4 

lO 

o 

X 

lO 

50.3 

10 

1.82  X  10“4 

0.001 

8.18  x  10“4 

4.50  x  10~4 

9.40  X  10“r 

4.50  x  10“' 

550 

100 

1.98  X  10~5 

0.001 

9.79  X  10-4 

4.95  X  10“4 

1.28  X  10“6 

4.95  x  10“7 

505 

— *■  -X) 

0 

0.001  . _ 

9.99  x  10“4 

5  X  10“4 

__1.33_x_10“6 

5  X  IQ"'  _ 

500 

10 

1.82  X  10“° 

1  X  10~4 

8.18  x  10-’ 

4.50  X  10“6 

9.42  X  10“u 
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The  time-averaged  error  variance  of  the  new  estimator’s 
output,  denoted  as  a2,  is  defined  as 

k 

v2  =  j  -  »(n)  ~  ^l2}  <21) 

n=fc  — L-f  1 

k  (lL~X 

=  \  ^  m))(x(n  —  m)  —  Hx 

n=  h  —  L  +  l  v  _m=0 

After  some  simplification,  the  RHS  of  (22)  becomes 


(T2  =  j  ^(1  -  A)2mir2  =  — (1  -  \)2crl-  (23) 

m—  1 

Finally,  we  consider  the  accumulation  of  errors  in  ]j(k)  in 
a  finite-precision  environment.  The  numerical  model  in  this 
case  is  similar  to  that  in  (14)  and  is  given  by 


t  \  r—i 


»(*)  =  < 


A[*/(k)  —  x(k  —  L)\  -f  x(lc)  +  f.o(k)  -{-  <Mk), 

if  kmodL  =0  (r>  . 
y(k)  —  Az(k  —  X)  -}-  x(k)  +  e;(k), 

otherwise. 


For  simplicity,  we  only  consider  the  worst-case  performance 
by  determining  the  level  of  numerical  errors  in  ~y(k)  at  time 
instants  k  ~  nL  —  1.  By  defining  7 (nL  —  1)  =  y_(nL  —  1)  — 
y(nL  —  1),  it  can  be  shown  that 

7(?zL-l)  =  A?((tt-l)Z-l)  +  e0((rc-l)£) 

L 

+  €j(nL  —  m).  (25) 

m=  1 

Thus,  the  limiting  value  of  the  variance  of  f.(nL  —  1)  is 

,.  2,  r  ,n  (I  +  1)<T? 

Inn  cr^riL  —  1)  =  - — — •  (26) 

n-oo  1  -  A" 

We  now  compare  the  performances  of  the  recursive  esti¬ 
mators  in  (4)  and  (8).  For  this  comparison,  we  equate  the 
numerical  precision  error  variances  as  expressed  by  (17)  and 

(26),  respectively,  and  solve  for  A  in  terms  of  A: 


5  -  ITT'1"1’’-  <2T) 

Then,  we  compute  the  average  biases  and  error^  variances 
for  each  algorithm  using  their  respective  A  and  A.  Table  1 


shows  the  values  of  the  biases  J  and  Ji  as  well  as  the  error 
variances  a2  and  a2,  normalized  by  L(xx  and  La 2,  respec¬ 
tively.  In  each  case,  it  is  observed  that  the  proposed  scheme 
has  less  bias  and  less  error  variance  than  the  exponentially- 
windowed  scheme.  Thus,  the  proposed  scheme  is  to  be  pre¬ 
ferred  from  the  standpoint  of  numerical  performance. 

4.  SIMULATIONS 

4.1.  Sliding  DFT 

We  now  explore  the  numerical  performance  of  the  sliding 
DFT  in  (2),  the  proposed  sliding  DFT  in  (8),  and  the  LMS 
spectrum  analyzer  in  [13],  via  simulations  in  the  MATLAB 
floating-point  computational  environment.  In  each  case, 
we  have  computed  the  L  =  16-point  sliding  DFT  of  a  se¬ 
quence  of  unit-variance  Gaussian  random  variables  using 
each  method,  and  we  then  calculate  the  total  squared  nu¬ 
merical  error  between  the  resulting  16  signals  and  those 
obtained  from  MATLAB’s  fft()  function  at  each  time  in¬ 
stant.  For  the  proposed  method,  we  have  chosen  A  =  0.999. 

Fig.  1  shows  the  total  squared  numerical  errors  for  the 
three  methods  as  a  function  of  time,  where  we  have  only 
plotted  the  errors  when  kmodL  —  L  —  1  such  that  all  of 
the  methods  would  compute  the  exact  DFT  in  an  infinite- 
precision  environment.  As  can  be  seen,  the  numerical  errors 
of  both  the  standard  sliding  DFT  and  LMS  spectrum  ana¬ 
lyzer  grow  linearly  over  time,  whereas  that  of  the  proposed 
technique  does  not  exhibit  such  growth.  While  the  growth 
in  numerical  errors  are  not  severe  in  this  floating-point  com- 
puational  environment,  these  results  indicate  that  the  pro¬ 
posed  technique  mitigates  numerical  growth  of  errors,  un¬ 
like  the  other  recursive  methods. 

4.2.  Recursive  Least-Squares  Adaptive  Filtering 
In  sliding- window-covariance  RLS  adaptive  filters,  one  min¬ 
imizes  the  error  criterion 

L-l 

J(W(k))  =  Y2[d[k  -  m)  -  WT(k)X(k  -  m)]2,  (28) 

m  =  0 

where  d(k)  is  a  desired  response  signal,  X(fc)  =  [x(k) 

•  •  •  x(k  —  N  -j-  1)]T  is  the  input  signal  vector,  and  W(k)  = 
[’Wo(n)  •••  Wiv-i(k)]T  is  the  FIR  filter  coefficient  vector  at 
time  k.  The  cost  function  minimum  occurs  at 


W  (k)  =  R"1  (k)P(k), 

(29) 

R  (*) 

L  —  1 

=  X(k  -  m)XT(k  -  m) 

(30) 

m  —  0 

L  —  1 

P  (k) 

=  ^d(k-m)X{k-m). 

m  —  Q 

(31) 

Table  2:  The  0(N2)  stabilized  SWC-FTF  algorithm. 
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Fig.  1:  Squared  numerical  errors  -  sliding  DFT  methods. 

Comparing  R (k)  and  P [k)  with  y(k)  in  (1),  it  is  clear  that 
we  can  recursively  compute  them  in  a  similar  manner.  Such 
a  calculation  is  margin  ally-stable,  however,  and  therefore, 
any  implementation  that  explicitly  or  implicitly  employs 
such  recursions  experiences  numerical  error  accumulation 
in  a  finite-precision  environment. 

Given  our  previous  results,  it  is  natural  to  consider  a 
modified  cost  function  of  the  form 
L  — 1 

J(W(k))  =  ^2ho(k,m)[d{k-m)-WT (k)X(k-m)]2  (32) 

m=0 

where  ho(k,m)  is  as  defined  in  (6).  A  similar  derivation 
to  that  which  produces  (29)-(31)  can  be  performed  for 
J(W(k)),  and  the  solution  obtained  is  identical  to  (29) 
except  that  the  corresponding  R (k)  and  P(&)  are  identical 
in  form  to  y(k)  in  (5).  Thus,  we  compute  R (k)  recursively 
as 


R(*)  = 


A[R(Jk)  -  X(k  -  L)XT(k  -  L)}  +  X(k)XT(k) 
if  kmodL  =  0 

R(k)  -  A X(k  -  L)XT(k  -  L)  +  X(k)XT(k)  ’ 
otherwise, 


and  P  (k)  has  a  similar  update.  The  resulting  recursive 
solution  for  W (k)  is  numerically-stable,  because  the  up¬ 
dates  for  R (k)  and  P (k)  are  numerically-stable.  Moreover, 
because  J(W (k))  =  J’fW^fc))  for  k  =  nL  —  1,  we  have 
W (nL  —  1)  =  W (nL  —  1)  when  numerical  errors  are  ab¬ 
sent. 

By  applying  the  matrix  inversion  lemma  [20]  twice  to  the 
RHS  of  (33)  and  combining  the  resulting  update  with  that 
for  P (fc),  one  obtains  a  set  of  direct  updates  for  W (k).  Ta¬ 
ble  2  lists  the  equations  for  this  numerically-stable  version 
of  the  0(N2)  SWC-RLS  algorithm,  where  W(A;)  =  W L(k). 
This  algorithm’s  complexity  is  identical  to  that  of  the  orig¬ 
inal  SWC-RLS  algorithm  (A  =  1)  when  kmodL  ^  0.  Thus, 
the  two  algorithm^  complexities  are  similar  when  the  block 
length  L  is  large  relative  to  the  filter  length  N . 

We  now  provide  simulations  comparing  the  numerical 
performance  of  the  algorithm  in  Table  2  with  respect  to 
the  original  0(N2)  SWC-RLS  algorithm  in  the  MATLAB 
floating-point  computational  environment.  In  these  simu¬ 
lations,  x(k)  is  a  zero-mean  uncorrelated  Gaussian  signal 
with  unit  variance,  and  d(£)  is  generated  from  X(fc)  as 

d(k)  =  XT(k)Wopt  +  n(k),  (34) 


if  kmodL  —  0 

c(k)  =  = — — 

A  +  XT(fc)R“1(fc-  l)X{k) 

*ci»i  =  - . W-W' 

l  +  XT(k)Rl1(k-l)X(k) 

R-*,(fc)  =  R-1(fc-l)-C(fc)XT(fc)R-1(A--i) 

end 

e{k)  =  <i(fc)-XT(fc)WL(fc-l) 

W  L+i(k)  =  WL(k-l)  +  e(k)C(k) 

D  (k)  =  R-;i(A-)X(fc-L) 

7(fc)  =  (-A-1  +  XT(k  -  L)D(fc)) 

R  l\k)  =  R^^-D^D ^fcfr(k) 
u(k)  =  d(k_-L)-Xr(k-  L)WL+1(k) 

WL(fc)  =  WL+1(fc)+7(A-)^(A-)D(A-) _ 
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Fig.  2:  Squared  numerical  errors  -  SWC-RLS  algorithms. 

where  Wopt  =  [1  1  1]T,  N  =  10,  L  =  20,  and 

rj(k)  is  a  zero- mean  uncorrelated  Gaussian  signal  with  vari¬ 
ance  cr2  =  0.0001.  In  this  case,  we  compute  the  quan¬ 
tity  ||W(fc)  —  W0pt(fc)||2  with  A  =  0.995,  where  W opt(fc)  is 
obtained  by  directly  minimizing  the  cost  function  in  (28) 
at  each  iteration.  Fig.  2  shows  a  smoothed  version  of 
this  quantity  for  all  kmodL  =  L  —  1.  As  can  be  seen, 
the  numerical  errors  remain  small  for  the  proposed  im¬ 
plementation.  For  comparison,  we  also  show  the  quantity 
j| W(k)  —  Wopt(fc)||2  for  the  standard  SWC-RLS  algorithm, 
in  which  the  linear  growth  of  the  numerical  errors  is  read¬ 
ily  apparent.  These  results  indicate  the  ability  of  the  new 
method  to  stabilize  the  marginally-stable  SWC-RLS  up¬ 
dates.  Such  results  are  clearly  useful  in  real-time  situations, 
particularly  when  fixed-point  computations  are  employed. 

5.  EXTENSIONS 

When  processing  real-valued  signals,  a  real-valued  trans¬ 
form  such  as  the  discrete  cosine  transform  (DCT)  is  more- 
useful  than  the  DFT  for  certain  applications.  A  recursive 
method  for  computing  the  /th  bin  value  of  the  sliding  DCT 
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Fig.  3:  Squared  numerical  errors  -  sliding  DCT  methods. 


for  1  <  /  <  L  —  1  is  [17] 

ui(k)  =  jiy(k)  (35) 

y(k)  —  2 cos(Itt / L)y(k  -  1)  -  y(k  -  2)  +  x(k)  -  x(k -1) 

-  (-1  )l[x(k  -  L)  -  z(k  -L-  1)],  (36) 

where  7 1  =  \/2/L  cos(/7r/(2L))  for  1  <  /  <  L  —  1  and 

70  =  \/y/T. 

Similar  to  (8),  we  can  define  a  periodically-time-varying 
system  that  implements  the  sliding  DCT  in  a  numerically- 
stable  fashion.  This  system  replaces  y{k)  in  (35)  by 

'A[2cos  (lz/L)y(k  —  1 )  —  y(k  —  2)]  +  x(k) 

-  x(k  -  1)  -  A(-l)*[x(Jfc  -  L)  -  x(k  -  L  -  1)] 

if  kmodL  =  0 
2  cos(Ik  /  L)y(k  —  1)  —  A  y(k  —  2)  +  z(k) 
y(k)  =  <  _  —  1)  —  A(  — l)*[x(fc  —  L)  —  x(k  —  L  —  l)(p7) 

if  kmodL  =  1 
2  cos(/7r/ L)y(k.  -  1)  -  y(fc  -  2)  +  x(fc) 

-  x{k  - 1 )  -  A(  — l)*[x(fc  -  £)  -  x(fc  -  L  -  1)] 

,  otherwise. 

In  this  case,  a  second-order  recursive  system  is  employed, 
and  A  is  applied  to  the  recursive  terms  within  the  updates  in 
different  ways.  We  have  tested  the  numerical  performance 
of  this  implementation  in  a  manner  similar  to  that  used  to 
test  the  sliding  DCT  techniques  previously.  As  the  results 
in  Fig.  3  show,  the  proposed  technique  mitigates  the  growth 
in  numerical  errors  experienced  by  (35)-(36). 

As  the  proposed  methods  produce  a  mathemat.ically- 
accurate  result  for  kmodL  =  L  —  1,  we  can  easily  extend 
the  interval  over  which  y(k)  =  y(k)  for  each  system.  For 
the  DFT  and  DCT  methods  in  (8)  and  (37),  respectively, 
we  replace  the  test  kmodL  =  0  with  the  test  kmodM  =  0, 
where  M  >  L.  Then,  for  L  <  kmodM  <  M,  we  use  the 
marginally-stable  updates  (2)  and  (36)  to  compute  the  out¬ 
puts  of  each  system,  respectively.  The  value  of  y(k)  for  these 
systems  is  mathematically-identical  to  the  sliding  DFT  and 
DCT  over  the  intervals  L  —  1  <  kmodM  <  M.  A  similar 
approach  can  be  applied  to  the  SWC-RLS  algorithm  in  Ta¬ 
ble  2.  While  potentially-useful,  this  extension  reduces  the 
average  number  of  stabilizing  updates  by  the  factor  L/M 
over  that  of  the  original  method,  and  thus  one  can  expect 
that  the  levels  of  numerical  error  in  the  outputs  will  increase 
by  a  factor  of  approximately  M/ L. 


6.  CONCLUSIONS 

In  this  paper,  we  have  presented  recursive  systems  that 
implement  the  sliding  DFT  and  DCT  in  a  numerically- 
stable  fashion.  These  algorithms  employ  periodically-time- 
varying  linear  systems  that  mitigate  the  growth  in  numer¬ 
ical  errors  when  implemented  in  finite-precision  arithmetic 
while  exactly  computing  the  desired  quantities  over  a  por¬ 
tion  of  the  input  sequence.  Moreover,  we  have  applied 
this  technique  to  the  0{N2)  sliding-window-covariance  RLS 
adaptive  filter,  showing  that  the  linear  accumulation  of  nu¬ 
merical  errors  of  the  original  system  does  not  occur  in  the 
proposed  system.  These  methods  are  expected  to  have  wide 
use  in  a  number  of  practical  signal  processing  systems,  in¬ 
cluding  the  implementation  of  adaptive  filtering  algorithms. 
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ABSTRACT 

The  coefficient  delays  within  the  updates  of  the  de¬ 
layed  LMS  and  filtered-X  LMS  algorithms  can  limit 
the  performances  of  these  schemes  in  practical  ap¬ 
plications.  Previously,  delay  compensation  meth¬ 
ods  have  been  proposed  to  overcome  these  difficul¬ 
ties.  In  this  paper,  we  present  a  unifying  view  of 
these  delay  compensation  methods  and  derive  a  new 
efficient  implementation  of  the  modified  filtered-X 
LMS  algorithm.  We  also  consider  and  present  effi¬ 
cient  delay-compensated  algorithms  for  systems  in 
which  the  delay  path  is  time-varying.  Simulations 
verify  the  useful  performances  of  the  schemes. 

1.  INTRODUCTION 

Stochastic  gradient  adaptive  filters  are  useful  for  applica¬ 
tions  in  communications,  control,  and  signal  processing.  In 
some  applications,  however,  it  can  be  difficult  to  implement 
even  the  simplest  structures.  This  difficulty  is  caused  by 
the  dependence  of  the  filter  error  at  time  n  on  the  most- 
recent  coefficient  values.  In  VLSI  implementations  of  the 
least-mean-square  (LMS)  adaptive  filter,  for  example,  this 
dependence  makes  the  pipelining  of  the  system  a  challenge. 
Approximate  versions  of  the  adaptive  filter  that  introduce 
delay  within  the  coefficient  updates,  such  as  the  delayed 
LMS  algorithm  [1,  2],  are  often  employed.  In  feedforward 
adaptive  control  systems,  the  filtered-X  LMS  algorithm  em¬ 
ploys  a  distributed  form  of  delay  to  approximate  a  gradient 
descent  procedure  on  a  mean-squared  error  surface  [3.  4]. 

Although  useful,  these  modified  algorithms  usually  per¬ 
form  worse  than  their  original  counterparts  due  to  the  de¬ 
lays  incurred  within  the  algorithms’  updates  [1,  4].  Re¬ 
cently,  various  techniques  have  been  developed  that  com¬ 
pensate  for  the  feedback  delays  within  the  delayed  LMS 
and  filtered-X  LMS  algorithms  [5]-[ll],  These  techniques 
achieve  performance  that  is  similar  to  that  of  the  LMS  algo¬ 
rithm  while  enabling  the  practical  implementation  of  these 
systems.  Little  is  known  about  the  structure  and  rela¬ 
tionships  between  these  methods,  however,  nor  is  it  clear 
whether  additional  implementations  are  possible.  More¬ 
over,  none  of  these  methods  apply  to  systems  with  time- 
varying  delay  paths,  such  as  the  filtered-X  LMS  algorithm 
with  an  on-line  plant  impulse  response  estimator  [3]. 

In  this  paper,  we  provide  a  unifying  view  of  the  delay 
compensation  methods  presented  in  [5]— [1 1]  by  studying 
their  general  algebraic  structure,  and  a  new  implementa¬ 
tion  of  the  modified  filtered-X  LMS  algorithm  is  derived. 
In  addition,  we  consider  systems  with  a  time-varying  feed¬ 
back  delay  and  provide  an  efficient  delay-compensated  al¬ 
gorithm  for  this  case.  Simulations  verify  the  usefulness  of 
the  methods  for  feedforward  control  tasks. 


Fig.  1:  The  filtered-X  LMS  algorithm. 

2.  DELAY  COMPENSATION  FOR  ADAPTIVE 
FEEDFORWARD  CONTROL 

2.1.  Filtered-X  LMS  Algorithm 

For  convenience,  we  first  review  the  filtered-X  LMS  al¬ 
gorithm,  which  includes  the  delayed  LMS  algorithm  as  a 
special  case.  Fig.  1  shows  the  structure  of  this  algorithm, 
in  which  an  output  actuator  signal  y(n)  is  computed  from 
an  input  sensor  signal  x(n)  as 

L  — 1 

y(n)  =  -  Q,  (1) 

1=0 

where  W{(n),  0  <  /  <  L  -  1  are  the  L  controller  coefficients 
at  time  n.  The  output  signal  propagates  to  the  error  sensor, 
where  it  combines  with  the  desired  response  signal  d(n)  to 
produce  the  error  signal 

M 

e(n)  =  d(n)  +  ^  hmy{n  -  m),  (2) 

m=l 

where  hm,  1  <  m  <  M  is  the  plant  impulse  response. 

In  the  filtered-X  LMS  algorithm,  we  update  tni(n)  as 

wi(n  +  1)  =  wi(ra)  —  g(n)e{n)  f  {n  —  /),  (3) 

where  the  filtered  input  signal  is  computed  as 

M 

f{n)  =  ^  hmx(n  -  m).  (4) 

771=  1 

This  algorithm  requires  2 L  +  M  +  1  multiply /accumulates 
(MACs)  per  iteration  to  implement,  assuming  that  e(n)  is  a 
measured  quantity.  To  obtain  the  delayed  LMS  algorithm, 
set  hm  =  <5 77i _ \f ,  where  M  is  the  amount  of  delay. 

°This  material  is  based  upon  work  supported  by  the  U.S.  Army 
Research  Office  under  grant  number  DAAH04-96- 1-0085,  The  con¬ 
tent  of  the  paper  does  not  necessarily  reflect  the  position  or  the 
policy  of  the  federal  government,  and  no  official  endorsement  should 
be  inferred. 


Fig.  2:  The  modified  filtered-X  LMS  algorithm. 

2.2.  The  Modified  Filtered-X  LMS  Algorithm 
Because  the  error  e(n)  contains  delayed  coefficients  — 

*)},  1  <  i  <  M,  the  filtered-X  LMS  algorithm’s  adaptation 
performance  is  degraded  with  respect  to  an  equivalent  LMS 
algorithm  that  uses  the  error 

L  — 1 

l(n)  =  d(n)  +  wi(n)f(n  -  /).  (5) 

i- 0 

In  [5],  a  method  for  calculating  7 (n)  from  the  error  sen¬ 
sor  signal  e(7i)  is  given.  This  algorithm  has  been  termed 
the  modified  filtered-X  LMS  algorithm  [5],  the  constraint 
filtered-X  LMS  algorithm  [6],  and  the  LMS  algorithm  for 
active  noise  control  [9].  This  technique  computes  the  cor¬ 
rection  term 

M  L- 1 

t(n)  =  ^  hmy{n  ~  m)  -  y  wi(n)f(n  -  /),  (6) 

m=l  f=0 

such  that 

7(n)  =  e(n)-t(n).  (7) 

Then,  the  coefficients  are  updated  as 

wt(n  +  l)  =  wi(n)  —  in(n)f(n  -  /),  (8) 

where  7 M(n)  =  //(  11)7(71).  Fig.  2  shows  the  block  diagram 
of  this  system.  If  the  impulse  response  hm  used  to  compute 
t(n)  accurately  models  the  characteristics  of  the  physical 
plant,  then  this  algorithm’s  behavior  is  similar  to  that  of 
an  LMS  algorithm  with  desired  response  signal  d(n)  and 
input  signal  f(n). 

Examining  this  algorithm,  it  is  found  that  it  requires 
3L  +  2 M  +  1  MACs,  which  is  L  +  M  more  MACs  than 
the  filtered-X  LMS  algorithm.  If  L  is  large,  then  this  al¬ 
gorithm’s  complexity  can  prohibit  its  real-time  implemen¬ 
tation. 


Fig.  3:  Alternate  modified  filtered-X  LMS  algorithm. 

By  iterating  (8)  backwards  in  time  by  i  iterations,  we  obtain 

t 

Wj(n)  -  Wj(n  -  i)  -  -  y  7M(n  -  k)f(n  -  j  -  k)(  1 1 ) 
k=l 

Substituting  (11)  into  the  RHS  of  (10),  we  obtain 
A/  l-  1 

t(n)  =  y  ft»y  x(n  -  i  -  j) 

i  =  l  j=0 

t  A/ 

x  y  7m(»  -  *)  y  -]~k-  /),  ( 12) 

fc=i  i-i 

where  we  have  used  (4)  to  expand  f(n  —  j  —  k)  in  (11). 

The  four  summations  on  the  RHS  of  (12)  can  be  ordered 
in  4!  =  24  different  ways,  and  these  orderings  can  produce 
different  algorithms.  It  appears,  however,  that  only  a  lim¬ 
ited  number  of  these  algorithms  are  both  computationallv- 
efficient  and  useful.  Two  of  these  cases  are  now  considered. 

Case  1:  By  ordering  the  the  summations  in  (12)  in  terms 
of  their  indices  as  we  have 

M  1  L- 1 

t{n)  =  T  ~  k)Y*[n  -  i  -  j)f(n  -  k  -  j)  (13) 

i—  1  *  =  1  J-O 

Define 

L  — 1 

r xf  ,m { n )  =  ^  ^  % ( n  j  m)f(n  j).  (14) 

j?=o 

Then,  we  can  express  (13)  as 


2.3.  Alternate  Implementations  of  the  Modified 
Filtered-X  LMS  Algorithm 
In  [8]-[ll],  alternative  forms  of  the  modified  filtered-X  LMS 
algorithm  are  developed.  In  this  section,  we  explore  the 
general  structure  of  these  delay-compensation  methods  and 
develop  a  new  implementation.  For  this  development,  we 
first  express  the  correction  term  in  (6)  as 

M  (  L  —  \  ^ 

t(n)  =  X  h'  yt”  -  0  -  X  x(n  ~ 1  ~ 

.=i  L  j=o  J 

M  L-l 

=  x(n  ~  i  ~  d){wAn  -  *)  -  Wj(n))(10) 

1=1  j=0 


M  i 

t(n)  =  y  ht  y  -  Ar)7M(w  -  k).  (15) 

i=l  k= 1 

Directly  computing  f(n)  as  in  (15)  requires  0(M2)  opera¬ 
tions  [8],  However,  by  defining 


i-i 

tt,(n)  =  Yjsf.i-kin  -  k)j^(n  -  fc),  (16) 

k-Q 


it  can  be  easily  shown  that 


rxf,o(ny^(n) 

ttt-i (n  -  1)  4-  r*/,,-(n)7M(rt) 


if  i  =  1 
if  2  <  i 


vv/17) 


Table  1:  Alternate  modified  filtered-X  LMS  algorithm. 


Equation 

MACs 

j  M  j 

7n(n)  =  7t(w)<e(w)  -  y  yk{n  -  1)7m(”  ~ 

L—l 

M  +  l 

y(n)  =  y ^Wi(n)x(n  -  l) 

L 

/<M+ 1  )(«)”  =  /<M+1>(n-i)  =  0 
for  j  =  M  to  2  step  (  —  1)  do 

0 

f^\n)  =  jO+1)(n) 

-  i  +  1) 

Af  -  1 

Wn-L)  =  /(j+1)(n-£) 

a:  (n  —  j  —  L  4*  1) 

M  -  1 

P]{n )  =  Pj(n  ~  1)  +  /(«  -j  +  l)/(j)(re) 

2  A/  -  2 

-/(n  -  j  -  £  +  l)/^(n  -  L) 

end 

/(n  +  1)  =  /(2)(n)  +  hix(n) 

1 

Pi(n)  =  pi(«-l)+/(n  +  l)/(n) 

!  2 

-/(«  -  L  +  l)/(n  -  L) 
for  /  =  0  to  L  —  1  do 

u;j(n +  1)  =  u;i(n)  -  7^(n)/(n  - /) 
end 

L 

Total:  2 X  +  5M 

Such  a  computation  is  of  reasonable  complexity  because 
rxf,i{n)  can  be  easily  updated  as 

Txf,i{n)  =  rxfii(n  -1)4*  x(n  -  i)f(n) 

—  —  L  -  i)f(n  —  L).  '  (18) 

The  resulting  algorithm  is  identical  to  that  in  [l  1] .  This 
implementation  requires  2 L  4-  5 M  +  1  MACs  to  implement, 
which  is  simpler  than  that  in  [8]  when  M  >  4. 

Case  2:  We  now  consider  the  ordering  of  the  summations 
in  (12)  as  {k.j,l,i}.  Then,  the  expression  becomes 

M  L—l  M 

t(n)  =  -  kj'y'  fjn  -  j  -  k)'y'h,x(n  -  i  -  j)  (19) 

k=  1  j~0  i  =  k 

Define 


Fig.  4:  Modified  fiitered-X  LMS  algorithm  for 
time- varying  plants. 

Pk[n)  =  pk(n  -  1)  4*  f(n  -  k  +  l)/k)(n) 

-f(n-k-L  +  l)f^\n-L).  (24) 

Table  1  lists  the  operations  of  this  new  algorithm.  It  re¬ 
quires  2 L  +  5 M  MACs  to  implement,  a  complexity  that  is 
almost  identical  to  that  of  the  algorithm  in  Case  1  above. 
Fig.  3  shows  the  structure  of  this  algorithm,  in  which  the 
delay  compensation  appears  as  a  time- varying  HR  filter  act¬ 
ing  on  the  error  signal  e(n). 

3.  DELAY  COMPENSATION  FOR 
TIME- VARYING  PLANTS 

When  the  plant  impulse  response  hm(n)  varies  with  time, 
the  filtered-X  LMS  algorithm  suffers  an  additional  perfor¬ 
mance  degradation.  Define 

M 

fi(n)  ~  ^  hm{i)x(n  -  m).  (25) 

771=  1 


L  —  l  M 

Pk{n)  =  y  f(n  -  j  -  k  4*  1)  y  hi£(n  -  i  -  j  +  1).  (20) 

j= 0  i-k 

Then,  we  have 

M 

t(n)  =  ^?fc(n-  l)7»(n-k).  (21) 

kss  1 

Furthermore,  by  defining 

M 

f(k)(n)  —  y  hix(n  -  i  +  1),  (22) 

i-k 

then  both  pfc(n)  and  f^k\n)  have  simple  combined  order- 
and  time-recursive  updates,  given  by 


fW(n)  = 


hMx(n  -  M  +  1)  if  &  =  M  , 

f(k+1)(n)  +  A*jc(n  -  k  +  1)  if  k  <  } 


The  filtered-X  LMS  algorithm  uses  f(n  —  /)  =  fn-i(n  —  /) 
to  update  wi(n)  in  (3).  If  an  instantaneous  known  change 
occurs  in  the  plant  impulse  response,  the  value  of  f(n  —  l) 
is  incorrect  for  l  time  instants  following  the  change.  When 
L  is  large,  this  difference  can  cause  an  extended  period  of 
divergence  in  the  controller  coefficients.  This  problem  is 
not  solved  by  any  of  the  methods  in  Section  2. 

To  provide  correct  convergence  behavior  for  the  filtered- 
X  LMS  algorithm,  one  should  compute  /n(n  —  /),  0  <  f  < 
L  —  1  at  each  time  instant  and  use  /n(ft-*0  in  place  of  /(  /?.—/) 
in  (3).  If  delay  compensation  for  time- varying  plants  is  also 
desired,  then  t(n)  is  calculated  as 

M  L  —  l 

*(»)  =  y  hm{n)y(n  -  m)  -  ^  wi(n)fn(n  -  /),(26) 

m=l  1  —  0 

and  7(71)  is  used  in  place  of  e(n)  within  the  updates.  Fig.  4 
shows  the  structure  of  this  modified  filtered-X  LMS  al¬ 
gorithm  for  time-varying  plants.  This  algorithm  requires 


Fig.  5:  Average  squared  errors  of  the  competing  schemes. 

LM  +  3 L  +  M  +  1  MACs  to  implement  and  is  significantly 
more  complex  than  the  algorithms  presented  previously. 

To  simplify  the  algorithm’s  implementation,  we  first 
relate  the  filtered-X  LMS  algorithm  to  the  delay  com¬ 
pensation  portion  of  the  fast  affine  projection  algorithm 
[12,  13].  It  can  be  shown  that  the  alternate  implementa¬ 
tion  of  the  filtered-X  LMS  algorithm  described  in  Section 
III  of  [10],  when  used  with  a  time-varying  plant,  imple¬ 
ments  the  filtered-X  LMS  algorithm  with  f(n  —  l)  replaced 
by  fn(n  —  /).  Then,  by  combining  this  algorithm  with  a 
slightly-modified  version  of  the  delay  compensation  method 
in  [11],  we  obtain  an  efficient  implementation  of  the  modi¬ 
fied  filtered-X  LMS  algorithm  for  time-varying  plants  [14]. 
Table  2  lists  the  equations  for  this  algorithm,  which  re¬ 
quires  2L  +  M 2  +  6 M  4*  1  MACs  at  each  iteration.  For 
L  >  M ( M  +  5 )/(M  +  1),  this  version  is  more  efficient  than 
that  in  Fig.  4,  and  its  performance  is  much  improved  over 
the  algorithms  of  Section  2  when  hm(n)  is  time- varying. 

4.  SIMULATIONS 

We  now  verify  the  performances  of  the  algorithms  via  simu¬ 
lations.  Fig.  5  shows  the  average  squared  error  E{e2(n)}  for 
the  filtered-X  LMS  {(.i(n)  =  0.0004),  the  alternative  modi¬ 
fied  filtered-X  LMS  (p(n)  =  0.0006),  and  the  efficient  mod¬ 
ified  filtered-X  LMS  (p(n)  =  0.0016)  algorithms  for  time 
varying  plants,  respectively,  as  averaged  from  20  simulation 
runs.  In  this  case,  d(n)  was  generated  by  applying  a  ten- 
tap  unity-coefficient  filter  to  a  white  Gaussian  signal  x(n) 
with  E{x2(n)}  =  1,  hm  =  0.9m,  M  =  10,  and  L  =  100. 
At  time  n  =  10000,  the  values  of  km  were  inverted,  and 
the  chosen  values  of  pt(n)  provided  the  fastest  convergence 
behavior  without  divergence  in  each  case.  The  algorithm  in 
Table  2  performs  the  best  of  the  three,  and  the  algorithm 
in  Table  1  outperforms  the  filtered-X  LMS  algorithm. 

5.  CONCLUSIONS 

We  have  considered  methods  for  compensating  the  feedback 
delays  of  the  delayed  LMS  and  filtered-X  LMS  algorithms. 
From  the  structure  of  the  calculations,  we  have  derived  a 
new  implementation  of  the  modified  filtered-X  LMS  algo¬ 
rithm.  We  also  have  presented  a  novel  adaptation  algorithm 
for  systems  with  time-varying  plants.  Simulations  indicate 
that  the  delay-compensated  algorithms  can  outperform  the 
filtered-X  LMS  algorithm.  The  proposed  methods  are  ex¬ 
pected  to  be  useful  for  a  number  of  tasks  in  communications, 
control,  and  signal  processing. 


Table  2:  Efficient  modified  filtered-X  LMS  algorithm  for 
_ time-varying  plants. 


Equation 


for  m  =  0  to  M  do 

rm(n)  =  rm(n  -  \)  +  x(n)x(n  -  m) 

—x(n  -  L)x(n  —  L  -  m) 

end 

f  M  ) 

7M(n)  =  fi(n)  ^  e(n)  -  hm (n)um(n  -  1)  ] 

l  m=  1  J 

L  —  l 

y(n)  =  ^2wi(n)x(n  -  l) 

1  =  0 
Af-l 

-]Tem(n-l)r 

m  +  l(n) 

m  =  1 

ci(nl  =  h\  (n)7M(n) 

ei  (n)  =  ci(n) 

for  rn  =  1  to  M  —  1  do 

cm+i(n)  =  /im+i  (nh^(n) 
em+l  (^)  “  ( n  1)4“  ^m+ 1  (ri) 

end 

M 


(n)  =  y^c9(n)rq(n) 

-  1  do 

iim(n  - 
M 

4"^  ^cq(n)  r  m—  q  (n  -  q) 


ai 


<7=1 

for  m  =  1  to  M  —  1  do 
Um+l(n)  =  tim(n  -  1) 
M 


q=l 

end 

for  J  =  0  to  L  -  l^do 

Wl(n  +  1)  =  wi(n)  —  eM(n)x(n  —  M  —  l) 

-end _ _ _ _ _ _ _ 

Total:  2L  4-  M  4-  b/Vf  4*  1 


2A/  +  2 

M  4-1 

L  4-  M  -  1 


M  -  1 
M  -  1 


M 


M(M  -  1) 
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Fast  Implementations  of  the 
Filtered-X  LMS  and  LMS  Algorithms 
for  Multichannel  Active  Noise  Control 
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Abstract — In  some  situations  where  active  noise  control  could 
be  used,  the  well-known  multichannel  version  of  the  filtered-X 
least  mean  square  (LMS)  adaptive  filter  is  too  computationally 
complex  to  implement.  In  this  paper,  we  develop  a  fast,  exact 
implementation  of  this  adaptive  filter  for  which  the  system’s 
complexity  scales  according  to  the  number  of  filter  coefficients 
within  the  system.  In  addition,  we  extend  computationally  effi¬ 
cient  methods  for  effectively  removing  the  delays  of  the  secondary 
paths  within  the  coefficient  updates  to  the  multichannel  case,  thus 
yielding  fast  implementations  of  the  LMS  adaptive  algorithm  for 
multichannel  active  noise  control.  Examples  illustrate  both  the 
equivalence  of  the  algorithms  to  their  original  counterparts  and 
the  computational  gains  provided  by  the  new  algorithms. 

Index  Terms —  Acoustic  noise,  active  noise  control,  adaptive 
control,  adaptive  filters,  adaptive  signal  processing,  least  mean 
square  methods,  vibration  control. 


I.  Introduction 

INTEREST  in  active  methods  for  the  suppression  of  noise 
and  vibration  has  grown  recently,  as  evidenced  by  the 
numerous  review  articles  and  books  that  have  appeared  on  the 
subject  [l]-[9].  Although  the  potential  for  active  noise  and 
vibration  control  has  long  been  recognized  [10],  successful 
implementations  of  these  techniques  have  begun  to  appear 
only  recently.  Such  success  can  be  attributed  to  the  rapid 
maturation  of  technology  in  three  areas:  1)  novel  electroacous¬ 
tic  transducers,  2)  advanced  adaptive  control  algorithms,  and 
3)  inexpensive  and  reliable  digital  signal  processing  (DSP) 
hardware.  As  advances  in  these  areas  are  developed,  active 
suppression  of  noise  and  vibration  can  be  expected  to  find 
wider  use  in  a  number  of  commercial,  industrial,  and  military 
applications.  In  this  paper,  we  focus  on  the  algorithms  used 
in  multichannel  active  noise  and  vibration  control  systems  as 
implemented  in  DSP  hardware. 

Perhaps  the  most  popular  adaptive  control  algorithm  used 
in  DSP  implementations  of  active  noise  and  vibration  control 
systems  is  the  filtered-X  least-mean-square  (LMS)  algorithm 
[11].  There  are  several  reasons  for  this  algorithm’s  popularity. 
First,  it  is  well-suited  to  both  broadband  and  narrowband 
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control  tasks,  with  a  structure  that  can  be  adjusted  according 
to  the  problem  at  hand.  Second,  it  is  easily  described  and 
understood,  especially  given  the  vast  background  literature 
on  adaptive  filters  upon  which  the  algorithm  is  based  [12], 
[13].  Third,  its  structure  and  operation  are  ideally  suited  to  the 
architectures  of  standard  DSP  chips,  due  to  the  algorithm’s 
extensive  use  of  the  multiply/accumulate  (MAC)  operation. 
Fourth,  it  behaves  robustly  in  the  presence  of  physical  mod¬ 
eling  errors  and  numerical  effects  caused  by  finite-precision 
calculations.  Finally,  it  is  relatively  simple  to  set  up  and  tune 
in  a  real-world  environment. 

Despite  its  popularity,  the  standard  filtered-X  LMS  al¬ 
gorithm  suffers  from  one  drawback  that  makes  it  difficult 
to  implement  when  a  multichannel  controller  is  desired:  the 
complexity  of  the  coefficient  updates  for  the  finite  impulse 
response  (FIR)  filters  within  the  controller  in  these  situations 
is  much  greater  than  the  complexity  of  the  input-output 
calculations.  It  is  not  unusual  for  the  coefficient  updates  of 
the  standard  implementation  to  require  more  than  ten  times 
the  number  of  MAC’S  needed  to  compute  the  outputs  of 
the  controller  for  fixed  coefficient  values,  and  the  situation 
worsens  as  the  number  of  error  sensors  is  increased.  For  this 
reason,  recent  efforts  have  focused  on  ways  to  reduce  the 
complexity  of  the  filtered-X  LMS  algorithm  in  a  multichannel 
context.  Suggested  changes  include:  1)  block  processing  of 
the  coefficient  updates  using  fast  convolution  techniques  [14], 
2)  partial  updating  of  the  controller  coefficients  [15],  and  3) 
filtered-error  methods  [16] — [18].  While  useful,  these  methods 
often  reduce  the  overall  convergence  performance  of  the 
controller,  either  because  they  introduce  additional  delays  into 
the  coefficient  update  loop  or  because  they  throw  away  useful 
information  about  the  state  of  the  control  system.  Such  a 
performance  loss  may  not  be  tolerable  in  some  applications. 

In  addition  to  these  computational  difficulties,  the  multi¬ 
channel  filtered-X  LMS  algorithm  also  suffers  from  excessive 
data  storage  requirements.  This  algorithm  employs  filtered 
input  signal  values  that  are  created  by  filtering  every  input 
signal  by  every  output-actuator-to-error-sensor  channel  of  the 
acoustic  plant.  The  number  of  these  terms  can  be  an  order-of- 
magnitude  greater  than  the  number  of  controller  coefficients 
and  input  signal  values  used  in  the  input— output  calculations. 
As  typical  DSP  chips  have  limited  on-chip  memory,  system 
designers  may  be  forced  to  use  costly  off-chip  memory  within 
their  controller  architectures  that  can  further  slow  the  operation 
of  the  system  due  to  limits  in  input/output  data  throughput. 
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While  some  of  the  aforementioned  techniques  for  complexity 
reduction  also  have  reduced  memory  requirements,  the  per¬ 
formance  of  the  overall  system  is  effectively  limited  by  these 
methods. 

A  third  limitation  of  the  multichannel  filtered-X  LMS 
adaptive  controller  is  due  to  the  propagation  delays  caused 
by  the  physical  distances  between  the  output  actuators  and 
the  error  sensors.  Because  of  these  delays,  the  error  signals 
contain  delayed  versions  of  the  controller  coefficients,  and 
these  delays  lead  to  a  reduced  stability  range  for  the  stepsize 
parameter  and  slower  convergence  speeds  [19].  If  the  impulse 
responses  of  the  secondary  paths  between  the  output  actuators 
and  the  error  sensors  can  be  accurately  estimated,  then  it  is 
possible  to  approximately  calculate  the  true  LMS  adaptive 
updates  for  the  controller  filters,  as  described  in  [20]  and 
[21]  in  the  single-channel  case.  However,  a  straightforward 
extension  of  this  idea  to  the  multichannel  case  yields  an 
algorithm  with  approximately  twice  the  complexity  of  the 
original  filtered-X  LMS  controller.  More  recently,  techniques 
for  efficiently  calculating  the  LMS  adaptive  updates  for  a 
single-channel  controller  have  been  provided  in  [22] — [24]. 
These  techniques  have  not  been  extended  to  the  multichannel 
case,  however,  and  any  additional  simplifications  resulting 
from  such  an  extension  have  not  been  explored. 

In  this  paper,  we  present  novel  methods  for  reducing  the 
computational  and  memory  requirements  of  the  multichannel 
filtered-X  LMS  and  multichannel  LMS  adaptive  controllers. 
Our  solutions  are  alternative  implementations  of  these  systems 
that  are  mathematically  equivalent  to  the  original  implemen¬ 
tations,  and  thus  they  preserve  the  characteristic  robust  and 
accurate  behaviors  of  the  algorithms.  The  complexity  and 
memory  requirements  of  the  new  implementations,  however, 
are  significantly  reduced  over  those  of  the  original  imple¬ 
mentations,  especially  for  controllers  with  a  large  number 
of  channels.  Moreover,  since  the  filtered-input  signals  are 
not  needed  in  our  implementations,  the  excessive  memory 
requirements  of  the  original  implementations  are  avoided. 

This  paper  is  organized  as  follows.  For  simplicity  of  dis¬ 
cussion,  Section  II  presents  the  original  as  well  as  our  novel 
implementation  of  the  filtered-X  LMS  algorithm  in  the  single¬ 
channel  case,  although  the  new  implementation’s  computa¬ 
tional  savings  are  only  realized  in  the  multichannel  case. 
The  multichannel  extensions  are  provided  in  Section  in,  along 
with  illustrative  examples  indicating  the  computational  savings 
obtained  with  the  new  implementation.  In  Section  IV,  we 
provide  two  extensions  of  the  method  of  calculating  the  LMS 
coefficient  updates  for  an  adaptive  controller  in  [23]  to  the 
multichannel  case,  showing  how  the  algorithm  can  be  inte¬ 
grated  with  the  efficient  multichannel  algorithm  in  Section  in. 
Example  simulations  in  Section  V  show  the  equivalence  of 
the  new  algorithms  to  their  more  complex  counterparts,  and 
simple  methods  for  mitigating  the  marginal  stabilities  of  the 
sliding-window  calculations  within  the  new  algorithms  are 
provided.  As  for  mathematical  notation,  scalar  variables  are 
employed  throughout  the  paper  to  enable  the  algorithms’  direct 
translation  to  DSP  processor  code,  and  indices  of  parameter 
sets  are  for  the  most  part  lower-case  versions  of  the  variable 
designating  the  number  of  parameters;  e.g.,  wt(n)  for  0  <  l  < 


Fig.  1.  Single-channel  filtered-X  LMS  adaptive  controller. 


L-  1. 

H.  Single-Channel  Filtered-X  LMS  Algorithms 
A.  Standard  Implementation 

To  simplify  our  discussion,  we  initially  present  the  single¬ 
channel  filtered-X  LMS  adaptive  feedforward  controller; 
the  multichannel  filtered-X  LMS  algorithm  is  described  in 
Section  III.  Fig.  1  shows  a  block  diagram  of  this  system,  in 
which  a  sensor  placed  near  a  sound  source  collects  samples  of 
the  input  signal  x(n)  for  processing  by  the  system.  This  system 
computes  an  actuator  output  signal  y(n)  using  a  time-varying 
FIR  filter  of  the  form 

L-l 

y(n)  =  wi(n)x(n  -  0  (i) 

1=0 

where  wi(n ),  0  <  /  <  L  -  1  are  the  controller  coefficients  at 
time  n  and  L  is  the  controller  filter  length.  The  acoustic  output 
signal  produced  by  the  controller  combines  with  the  sound  as 
it  propagates  to  the  quiet  region,  where  an  error  sensor  collects 
the  combined  signal.  We  model  this  error  as 

CO 

e(n)  =  d(n)  +  ^  hmy(n  -  m)  (2) 

m=— co 

where  d(n)  is  the  undesired  sound  as  measured  at  the  error 
sensor  and  hm,  —  oo  <  m  <  co  is  the  plant  impulse 
response.  Note  that  (2)  is  never  computed  as  e(n)  is  a  mea¬ 
surement  of  a  physical  quantity.  In  addition,  (2)  assumes  that 
the  secondary  propagation  path  is  linear  and  time -invariant. 
Although  changes  in  room  acoustics  can  occur  over  time 
and  loudspeakers  often  have  nonlinear  transfer  characteristics 
at  low  frequencies  and  high  driving  levels,  we  assume  for 
simplicity  throughout  this  paper  that  (2)  is  an  accurate  model 
for  the  error  sensor  signal. 

The  filtered-X  LMS  coefficient  updates  are  given  by 

wi(n  +  1)  =  wi(n)  -  fJ>(n)e(n)f(n  -  l)  (3) 

where  fx(n)  is  the  algorithm  step  size  at  time  n,  the  filtered 
input  sequence  f(n)  is  computed  as 

M 

f(n)  =  -  m)  (4) 

771  =  1 

and  M  is  the  FIR  filter  length  of  an  appropriate  estimate  of 
the  plant  impulse  response.  In  practice,  the  values  of  hm  used 
in  (4)  are  estimates  of  the  actual  hm  in  (2)  and  are  usually 
obtained  in  a  separate  estimation  procedure  that  is  performed 
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prior  to  the  application  of  control.  For  notational  simplicity, 
we  will  not  distinguish  the  differences  in  these  two  parameter 
sets  in  what  follows.  A  discussion  of  the  performance  effects 
caused  by  errors  in  the  estimates  of  hm  can  be  found  in  [25]. 

A  study  of  (1),  (3),  and  (4)  shows  that  the  filtered-X 
LMS  algorithm  requires  2L  +  M  4*  1  MAC  operations  and 
2 L  4-  max{L,  M  -f  1}  4-  1  memory  locations  to  store  the 
necessary  wi(n),  h7n,  x(n  -  /),  and  f(n  -  l )  for  the  algorithm 
at  each  step.  For  typical  choices  of  the  controller  and  plant 
filter  lengths,  the  complexity  and  memory  requirements  of  this 
algorithm  are  reasonable.  As  will  be  shown,  however,  such  is 
not  the  case  for  the  natural  extension  of  this  algorithm  to  the 
multichannel  control  task. 

B.  New  Implementation 

We  now  describe  a  new  implementation  of  the  single¬ 
channel  filtered-X  LMS  algorithm  [26]— [28],  This  method 
combines  the  adjoint  LMS/corrected  phase  filtered  error 
(CPFE)  algorithm  [17],  [18]  with  a  method  for  delay 
compensation  used  in  fast  projection  adaptive  filters  [29], 
[30].  To  derive  the  implementation,  we  write  the  coefficient 
updates  of  the  original  algorithm  in  the  form 

M 

wi(n  4-  1)  =  wi(n)  -  p(n)e(n)  ^  hmx(n  -  l  -  m).  (5) 

m— 1 

Define  em(n)  for  1  <  m  <  M  as 

em(n)  =  hrnp(n)e(n).  (6) 

Then,  (5)  becomes 

M 

wi(n  4-  1)  =  wi(n)  -  ^  6m(n)x(n  -  l  -  m).  (7) 

m= 1 

We  can  represent  the  relation  in  (7)  for  M  successive  time 
steps  as 

M  —  l  M 

wi(n  -hi)  -  wi(n  -  M  4-  1)  -  ^  em(n  -  p) 

p—0  m= 1 

•  x(n  —  l  -  m  -  p).  (8) 

We  can  expand  the  summation  on  the  right-hand-side  of  (8)  in 
a  particularly  useful  way  as  in  (9),  shown  at  the  bottom  of  the 
page,  where  we  define  the  Ith  auxiliary  coefficient  wi(n)  as 

M  —  l  M 

wi(n)  =  wt(n  -  M  +  1)-  ^  ^  £m(n  -  M  +  rn  -  p) 

p=l  m=p+X 

(10) 


The  expression  in  (9)  indicates  an  important  fact  about  the 
structure  of  the  filtered-X  LMS  updates:  the  same  input  sample 
x(n  -  /  —  m)  is  used  in  successive  time  instants  to  update 
the  same  coefficient  wi(n).  We  can  exploit  this  structure  to 
develop  a  set  of  coefficient  updates  that  are  grouped  according 
to  the  individual  x(n  -  l  -m)  values  appearing  on  the  right- 
hand-side  of  (9).  Such  a  scheme  updates  the  Ith  auxiliary 
coefficient  wi{n)  rather  than  the  actual  controller  coefficient 
wi(n).  Define  em(n)  as 

m 

fim(n)  -  ^2  £p(n  “  m  +p).  (11) 

P=1 

Then,  it  is  straightforward  to  show  that  Wt(n)  can  be  updated 
as 

wi(n  4- 1)  =  wi(n)  -  eM{n)x(n  -  M  -  l).  (12) 

Thus,  wi(n  + 1)  is  obtained  by  subtracting  from  wi(n)  the  last 
column  of  terms  on  the  RHS  of  (9). 

Since  eA/(n)  is  obtained  by  filtering  p(n)e(n)  by  the  time- 
reversed  plant  impulse  response  {hw,  Iim-i,  •  •  • ,  h\}y  (12)  is 
the  single-channel  version  of  the  adjoint  LMS/CPFE  algorithm 
[17],  [18].  What  is  novel  is  the  relationship  in  (9)  that 
provides  the  link  between  wi(n)  and  wi(n),  or,  equivalently, 
the  link  between  the  adjoint  LMS/CPFE  and  filtered-X  LMS 
algorithms.  We  can  use  (9)  to  compute  y(n)  for  the  filtered-X 
LMS  algorithm  using  wi(n)  as  calculated  by  (12).  To  proceed, 
we  substitute  the  expression  for  wi(n+ 1)  in  (7)  into  (9).  Using 
(11),  we  obtain 

M  —  l 

wi(n)  =  wi(n)  -  em(n  -  1  )x(n  -  l  -  m  -  1).  (13) 

m—l 

Substituting  the  expression  for  wi(n)  in  (13)  into  (1),  we 
produce  the  equivalent  expression 

L- 1  L  —  l  M—l 

y(n)  =  ^2  wi(n)x(n  -l)~Y2  em(n  “ 

0  /=0  m—l 

*  x(n  —  l  —  m  —  l)x(n  —  l ).  (14) 

Define  the  correlation  term  rm(n)  as 
L  —  l 

rm(n)  =  ^ 2  x(n  ~  l  ~  ™>)x(n  -  /).  (15) 

1=0 

Then,  (14)  becomes 

L- 1  M—l 

y(n)  =  Y2  v>i{n)x(n  -  l)  -  ^  em(n  -  l)rm+1(n).  (16) 

l— 0  m=l 


Wi(n  4- 1)  =  wi(n) 

-  £i(n)x(n  -  l  -  1)  -  €2{n)x(n  —  1  —  2) 

-  £i(n  -  l)ar(n  -1-2) 


£iv/(n)a;(n  -  l  -  M) 
£m-i{li  —  l)a:(n  -  l  -  M) 


£i (n  —  M  +  1  )x(n  -  l  —  M) 


(9) 
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Such  a  calculation  is  of  reasonable  complexity  because  rm(n) 
can  be  recursively  updated  as 

rm(n )  =  rm(n- 1)  +  x(n)x(n  -  m)  -x(n-  L)x(n-  L  -m). 

(17) 

Moreover,  eTO(n)  has  a  simple  order-recursive  update  of  the 
form 

,  if”=> 

[em-i(n-l)  +  hme^(n),  if  2  <  m  <  M 

u  08) 

where 

e^(n)  =  n(n)e(n).  (19) 

Collecting  (12)  and  (16)— (19),  we  obtain  a  set  of  equations 
that  exactly  computes  the  output  signal  of  the  filtered-X 
LMS  adaptive  controller.  This  algorithm  requires  2 L  + 
AM  -  1  MAC’S  to  implement  at  each  iteration.  Thus,  this 
version  is  more  computationallycomplex  than  the  original 
implementation  of  the  filtered— X  LMS  algorithm,  which 
only  requires  2L  +  M  +  1  MAC’s  per  iteration.  In  the 
multichannel  case,  however,  the  alternative  implementation 
can  save  operations  and  memory  storage,  as  we  now 
show. 

III.  Multichannel  Filterei>-X  LMS  Algorithms 


where 

€<f\n)  =  (24) 

A  careful  study  of  the  filtered-X  LMS  algorithm  described 
by  (20)  and  (22)-(24)  reveals  the  fact  that  this  implementation 
requires  IJK(L  +  M)  +  K  MAC’s  to  compute  the  coefficient 
updates,  even  though  computing  the  controller  outputs  only 
requires  IJL  MAC’s.  Thus,  the  complexity  of  the  update 
calculations  is  more  than  K  times  the  complexity  of  the 
input-output  calculations.  For  systems  with  a  large  number 
of  error  sensors,  the  computational  burden  of  the  coefficient 
updates  can  overwhelm  the  capabilities  of  the  processor  chosen 
for  the  control  task. 

The  standard  implementation  of  the  filtered-X  LMS  al¬ 
gorithm  also  has  memory  requirements  that  can  exceed  the 
capabilities  of  a  chosen  processor.  The  total  storage  needed 
is  IJ(K  +  1)1,  +  JKM  +  I  max(L,  M  +  1)  +  K,  and  for 
long  controller  filter  lengths,  the  bulk  of  this  storage  is  for 
the  IJKL  filtered  input  signals  /(*■>' fc>(n  -  l).  Clearly,  it  is 
desirable  to  find  alternative  implementations  of  the  filtered-X 
LMS  algorithm  that  have  reduced  computational  and  memory 
requirements.  We  now  present  an  algorithm  that  is  based  on 
the  method  described  in  Section  II. 


A.  Standard  Implementation 

We  now  describe  the  multichannel  version  of  the  filtered-X 
LMS  algorithm  in  its  original  implementation  [7],  [8].  In 
multichannel  control,  I  input  sensors  are  used  to  collect  / 
input  signals  xS1'1  (n) ,  1  <  i  <  /.  The  controller  computes  J 
output  signals  y^Xn),  1  <  j  <  J  as 

yU)(n)  =  J]  S  w(iiJ)(n)x(iXn  -  l)  (20) 

1=1  1=0 

where  wp3\n),  0  <  /  <  L- 1  are  the  L  FIR  filter  coefficients 
for  the  ith-input-to-j th-output  channel  of  the  controller.  The  J 
controller  output  signals  propagate  to  the  desired  quiet  region, 
where  K  error  sensors  measure  the  error  signals  e^Xn) 

1  <  k  <  K  as 

J  OO 

£(t)(n)=d«(n)  +  ^  £  (21) 

j  —  l  m=- oo 

and  Am  \  - oo  <  m  <  oo  is  the  ^‘th-output-to-A:th-error  plant 
impulse  response  channel. 

In  the  original  filtered-X  LMS  algorithm,  UK  filtered  input 
signals  computed  as 

M 

*>*<»(„-„,)  (22) 

m  =  l 

from  which  w,(,’j)(n)  is  updated  as 

wil'j)(n  +  1)  =  wf' j) (n)  -  £  eW(n)/0.;,*)(n  _  t)  (23) 

k= 1 


B.  New  Implementation 

We  consider  the  multichannel  extension  of  the  new  version 
of  the  filtered-X  LMS  algorithm  in  Section  II-B.  To  determine 
the  appropriate  grouping  of  terms  for  the  updates,  we  substitute 
the  expression  for  -  l )  in  (22)  into  the  update  in 

(23)  to  get 

w\l,iXn  + 1) 

K  M 

=  wil'3)(n )  -  23  ik)(n)  23  -  l  -  m)  (25) 

kxz  1  TTL—l 

M 

~  wi  *’j)(n)  “  53  £m(n)x(i)(n  - l-m )  (26) 


where  we  have  defined  the  JM  terms  s\£{n)  for  1  <  j  <  J 
and  1  m  <  M  as 

£m\n)  =  23  hm  k)^k){n).  (27) 

k=  1 

Because  (26)  and  (7)  are  similar  in  form,  we  can  use  a 
method  analogous  to  that  in  Section  II-B  to  implement  the 
multichannel  filtered-X  LMS  algorithm.  Define 

m 

em\n)  =  23  4j)(n  -m+p).  (28) 

P=i 

Then  we  can  define  a  set  of  IJL  auxiliary  coefficients 
wt  (n)  whose  updates  are  given  by 

wll'])(n  +  1)  =  w\l'3)(n )  -  e^(n)x(i)(n  -  M  -  l ).  (29) 
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TABLE  I 

Fast  Multichannel  Filtered-X  LMS  Algorithm 


To  compute  the  controller  outputs,  the  multichannel  equivalent 
of  (16)  is 

/  L~l 

y^\n)  =  ^  ^  w[l'j\n)x^(n  -  l) 
i= i  ;=o 
M- 1 

-  e™(n  ~  l)rm+i{n)  (30) 

m=  1 

where  rm(n)  in  this  case  is  defined  as 

I  L-l 

rm(n )  =  ^2  ^2  x(i)(n  -  l)x{i\n  -l-m).  (31) 

i~l  1=0 

In  analogy  with  (17),  rm(n)  can  be  recursively  computed  as 

/ 

rm(n)  =  Tm(n  -  1)  +  ^  jo;^(n)£^(n  -  m) 

-x^\n  -  L)x^l\n  —  L  —  ra)  j.  (32) 

Similarly  em  (n)  has  an  update  similar  to  that  in  (18),  as  given 
by 

r  K 

h[j'  k^e^\n),  if  m  =  1 

k=l 

emM  =  <  elU^n-l)  (33) 

K 

+^2  Am  fe)e^fc)(n),  if  2  <m<M. 

k  fc  =  l 

Collecting  (24),  (29),  (30),  (32),  and  (33),  we  obtain  an 
alternative,  equivalent  implementation  of  the  multichannel 


filtered-X  LMS  algorithm.  Table  I  lists  the  operations  of  this 
implementation,  along  with  the  number  of  MAC’s  required 
to  implement  each  operation.  The  algorithm  employs  2 IJL  + 
JKM  +  (21  -f  J)(M  —  1)  +  K  MAC’s  per  iteration,  and  it 
requires  IJL  +  JKM  +  IL  +  (I  +  J  +  1  )M  +  K-1  memory 
locations  to  implement. 

Remark:  This  implementation  of  the  multichannel  fil¬ 
tered-X  LMS  adaptive  controller  modifies  the  adjoint 
LMS/CPFE  adaptive  controller  by  including  the  second 
summation  on  the  RHS  of  (30)  and  the  supporting  updates 
for  e$(n)  and  rm(n),  respectively.  Since  e$(n)  is  of 
0(p(n)),  the  performance  difference  between  the  multichan¬ 
nel  filtered-X  and  adjoint  LMS/CPFE  algorithms  can  only  be 
expected  to  be  significant  for  large  stepsizes,  a  fact  that  has 
been  pointed  out  in  [17],  [18].  Because  the  adjoint  LMS/CPFE 
algorithm  is  a  filtered-error  technique  with  an  approximate 
group  delay  of  M  samples  in  the  update  rule,  however,  its 
performance  is  often  worse  than  that  of  the  filtered-X  LMS 
algorithm.  Moreover,  the  complexity  difference  between  the 
two  algorithms  is  relatively  insignificant  for  systems  with  a 
large  number  of  channels,  as  will  now  be  shown. 

C.  Complexity  Comparisons 

We  now  compare  the  computational  and  memory  require¬ 
ments  of  the  original  and  fast  implementations  of  the  mul¬ 
tichannel  filtered-X  LMS  algorithm.  In  this  comparison,  we 
consider  three  different  problem  scenarios.  Each  scenario  is 
defined  by  specific  choices  of  the  controller  filter  length  L 
and  plant  model  filter  length  M  that  might  be  appropriate  for 
a  particular  type  of  noise  or  vibration  control  task.  In  each 
case,  we  present  the  quantities  R ^  and  that  denote 

the  ratios  of  the  numbers  of  MAC’s  and  memory  locations, 
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TABLE  II 

Complexity  Comparison,  Standard,  and  Fast  Multichannel  Filtered-X  LMS  Algorithms,  L  =  50,  M  =  25 


' — 

# 

~ 1 

Complexity 

Memory 

1 

# 

Complexity 

Memory 

Channels 

Ratio 

Ratio 

Channels 

Ratio 

Ratio 

I 

J 

K 

n(AO 

lLp 

I 

J 

K 

d(G) 

Jl  p 

it  p 

1 

2 

2 

0.7512 

0.9900 

0.7235 

0.7765 

4 

6 

4 

0.3574 

0.3974 

0.3313 

0.3348 

1 

3 

2 

0.7508 

0.9502 

0.6933 

0.7301 

2 

6 

6 

0.3506 

0.3906 

0.3469 

0.3515 

1 

4 

2 

0.7506 

0.9302 

0.6772 

0.7054 

2 

8 

6 

0.3505 

0.3865 

0.3412 

0.3446 

1 

6 

2 

0.7504 

0.9101 

0.6605 

0.6797 

2 

8 

8 

0.3082 

0.3359 

0.3096 

0.3123 

2 

2 

2 

0.6259 

0.8055 

0.6259 

0.6559 

4 

8 

8 

0.2311 

0.2495 

0.2288 

0.2303 

2 

3 

2 

0.6256 

0.7654 

0.5877 

0.6085 

8 

8 

8 

0.1925 

0.2063 

0.1820 

0.1828 

2 

4 

2 

0.6255 

0.7453 

0.5672 

0.5832 

4 

8 

12 

0.1845 

0.1972 

0.1927 

0.1937 

2 

6 

2 

0.9253 

0.7252 

0.5459 

0.5568 

4 

12 

12 

0.1844 

0.1949 

0.1888 

0.1895 

1 

4 

4 

0.5726 

0.6752 

0.5358 

0.5523 

4 

16 

12 

0.1844 

0.1938 

0.1869 

0.1874 

1 

6 

4 

0.5722 

0.6635 

0.5241 

0.5353 

8 

8 

12 

0.1449 

0.1544 

0.1444 

0.1449 

2 

3 

3 

0.5009 

0.6025 

0.4928 

0.5085 

8 

8 

16 

0.1202 

0.1274 

0.1244 

0.1248 

1 

4 

6 

0.5015 

0.5733 

0.4771 

0.4888 

8 

12 

16 

0.1201 

0.1257 

0.1211 

0.1214 

3 

3 

3 

0.4552 

0.5424 

0.4490 

0.4601 

8 

16 

16 

0.1201 

0.1249 

0.1195 

0.1197 

3 

6 

3 

0.4549 

0.5130 

0.4111 

0.4168 

8 

32 

16 

0.1200 

0.1236 

0.1170 

0.1171 

2 

4 

4 

0.4294 

0.4979 

0.4209 

0.4305 

16 

16 

16 

0.1000 

0.1036 

0.0926 

0.0927 

2 

6 

4 

0.4291 

0.4862 

0.4060 

0.4125 

16 

32 

16 

0.1000 

0.1024 

0.0901 

0.0901 

2 

8 

4 

0.4290 

0.4804 

0.3985 

0.4033 

8 

16 

32 

0.0817 

0.0842 

0.0901 

0.0903 

4 

4 

4 

0.3576 

0.4090 

0.3484 

0.3536 

16 

16 

32 

0.0613 

0.0631 

0.0625 

0.0625 

2 

4 

6 

0.3510 

0.3989 

0.3582 

0.3651 

32 

32 

32 

0.0510 

0.0520 

0.0466 

0.0466 

TABLE  III 

Complexity  Comparison,  Standard,  and  Fast  Multichannel  Filtered-X  LMS  Algorithms,  L  =  2,  M  —  10 


— 

# 

“1 

Complexity 

Memory 

# 

Complexity 

Memory 

Channels 

Ratio 

Ratio 

Channels 

Ratio 

Ratio 

I 

J 

K 

rT 

4C) 

r(M) 

aA 

4° 

/ 

J 

K 

4C) 

4» 

4’ 

4' 

2 

2 

2 

0.5472 

1.0566 

1.0682 

1.1705 

6 

12 

6 

0.1901 

0.2306 

0.0.5900 

0.5950 

2 

3 

2 

0.5443 

0.9430 

1.0667 

1.1417 

6 

6 

12 

0.1663 

0.1970 

0.5398 

0.5450 

2 

4 

2 

0.5429 

0.8857 

1.0658 

1.1250 

6 

12 

12 

0.1653 

0.1859 

0.5274 

0.5301 

2 

2 

4 

0.4902 

0.7549 

0.9315 

0.9932 

8 

16 

12 

0.1307 

0.1461 

0.4570 

0.4587 

2 

4 

4 

0.4851 

0.6634 

0.9173 

0.9511 

8 

12 

16 

0.1245 

0.1380 

0.4433 

0.4450 

2 

6 

4 

0.4834 

0.6325 

0.9119 

0.9352 

8 

16 

16 

0.1243 

0.1359 

0.4401 

0.4414 

2 

6 

6 

0.4631 

0.5638 

0.8525 

0.8687 

8 

16 

24 

0.1178 

0.1256 

0.4227 

0.4236 

2 

6 

8 

0.4527 

0.5287 

0.8209 

0.8333 

8 

16 

32 

0.1146 

0.1204 

0.4138 

0.4145 

4 

6 

4 

0.2824 

0.3870 

0.7576 

0.7746 

16 

32 

16 

0.0723 

0.0781 

0.2937 

0.2941 

4 

8 

6 

0.2586 

0.3193 

0.6933 

0.7025 

16 

16 

32 

0.0625 

0.0669 

0.2707 

0.2711 

4 

8 

8 

0.2468 

0.2926 

0.6625 

0.6696 

16 

32 

32 

0.0623 

0.0652 

0.2669 

0.2671 

respectively,  required  by  the  fast  implementation  with  respect 
to  the  numbers  of  MAC’S  and  memory  locations  needed 
for  the  original  implementation.  For  comparison,  we  also 
provide  the  corresponding  ratios  R ^  and  R ^  for  the  adjoint 
LMS/CPFE  algorithm  [17],  [18]  with  respect  to  the  original 
filtered-X  LMS  algorithm.  Since  the  adjoint  LMS/CPFE  algo¬ 
rithm  equations  are  used  within  the  fast  implementation,  we 
have  that  r[^  <  R ^  and  R^  <  R^!\  although  the  two 
algorithms’  requirements  are  similar  for  systems  with  a  large 
number  of  channels. 

The  first  situation  considered  is  a  broadband  noise  control 
task  in  which  the  controller  and  plant  model  filter  lengths  are 
L  =  50  and  M  =  25,  respectively.  The  ratio  L/M  =  2 
offers  a  reasonable  balance  between  the  performance  and  the 
robustness  of  the  controller  for  fixed  hardware  resources  in 
many  applications.  Table  II  shows  the  complexity  and  memory 
ratios  for  the  different  cases  considered.  As  can  be  seen  for  all 
of  the  cases  considered,  the  number  of  multiplies  required  for 
the  new  implementation  of  the  multichannel  filtered-X  LMS 
algorithm  is  less  than  that  of  the  original  algorithm,  and  this 


difference  is  significant  for  systems  with  a  large  number  of 
channels.  In  fact,  for  an  iV-input,  N- output,  iV -error  system, 
the  complexity  of  the  new  implementation  is  approximately 
80%  of  the  original  implementation  when  N  =  2,  40%  of  the 
original  when  N  =  4,  20%  of  the  original  when  N  =  8,  and 
10%  of  the  original  when  N  =  16.  In  addition,  the  number 
of  memory  locations  required  by  the  new  implementation  is 
also  reduced  and  is  less  than  10%  of  the  original  algorithm’s 
memory  requirements  for  I  =  J  =  K  =  N  =  16. 
These  savings  are  significant,  as  they  allow  a  multichannel 
control  system  to  be  implemented  on  a  much  simpler  hardware 
platform. 

We  now  consider  tasks  in  which  L  =  2  and  M  =  10.  Such 
a  situation  is  typical  of  narrowband  noise  control  problems 
in  which  each  input  signal  is  a  single  sinusoid  of  a  different 
frequency;  thus,  each  channel  of  the  controller  is  dedicated  to 
one  tonal  component  of  the  unwanted  acoustic  field.  Table  III 
lists  the  ratio  of  MAC’S  and  memory  locations  for  the  two 
algorithms  with  respect  to  the  original  filtered-X  LMS  algo¬ 
rithm  in  this  situation.  As  can  be  seen,  except  for  systems  with 
a  small  number  of  channels,  the  new  implementation  requires 
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TABLE  IV 

Complexity  Comparison,  Standard,  and  Fast  Multichannel  Filtered-X  LMS  Algorithms,  L  -  10,  M  -  20 


# 

Complexity 

Memory 

# 

Complexity 

Memory 

Channels 

Ratio 

Ratio 

Channels 

Ratio 

Ratio 

I 

j 

K 

R(P 

4M) 

I 

J 

K 

R(C) 

dp 

rT 

) 

it  p 

2 

2 

2 

0.5745 

0.9787 

0.9098 

0.9877 

6 

12 

6 

0.2109 

0.2442 

0.3911 

0.3940 

2 

3 

2 

0.5735 

0.8886 

0.8779 

0.9331 

6 

6 

12 

0.1629 

0.1886 

0.3375 

0.3405 

2 

4 

2 

0.5730 

0.8434 

0.8604 

0.9032 

6 

12 

12 

0.1625 

0.1796 

0.3257 

0.3273 

2 

2 

4 

0.4656 

0.6832 

0.7488 

0.7956 

8 

16 

12 

0.1354 

0.1482 

.  0.2755 

0.2764 

2 

4 

4 

0.4636 

0.6092 

0.7102 

0.7350 

8 

12 

16 

0.1227 

0.1341 

0.2603 

0.2613 

2 

6 

4 

0.4629 

0.5844 

0.6963 

0.7131 

8 

16 

16 

0.1227 

0.1324 

0.2578 

0.2585 

2 

6 

6 

0.4226 

0.5057 

0.6381 

0.6499 

8 

16 

24 

0.1098 

0.1163 

0.2394 

0.2398 

2 

6 

8 

0.4016 

0.4648 

0.6067 

0.6158 

8 

16 

32 

0.1033 

0.1082 

0.2299 

0.2303 

4 

6 

4 

0.3086 

0.3937 

0.5452 

0.5560 

16 

32 

16 

0.0817 

0.0865 

0.1690 

0.1692 

4 

8 

6 

0.2639 

0.3138 

0.4760 

0.4818 

16 

16 

32 

0.0620 

0.0656 

0.1434 

0.1436 

4 

8 

8 

0.2408 

0.2787 

0.4440 

0.4485 

16 

32 

32 

0.0619 

0.0644 

0.1409 

0.1410 

only  a  fraction  of  the  MAC’S  and  memory  locations  used  by 
the  original  implementation.  Thus,  the  new  implementation 
reduces  the  controller’s  hardware  complexity  in  narrowband 
control  situations  as  well. 

The  third  problem  scenario  considered  is  a  task  in  which 
£  =  10  and  M  =  20.  These  choices  are  typical  for  noise  and 
vibration  control  tasks  in  which  the  input  signals  are  measured 
by  physical  sensors,  but  the  primary  goal  of  the  controller 
is  to  attenuate  a  relatively  few  number  of  tonal  components. 
Table  IV  lists  the  respective  complexity  and  memory  usage 
ratios  for  different  cases.  As  in  the  previous  cases,  we  find 
that  the  new  implementation  of  the  filtered-X  LMS  algorithm 
save  computations  and  memory  locations  for  systems  with  a 
large  number  of  channels. 


•»: 


Fig.  2.  Single-channel  LMS  adaptive  controller  employing  delay  compen¬ 
sation. 


IV.  LMS  Algorithms  for  Active  Noise  Control 
A.  Standard  Implementation 

In  this  section,  we  review  the  standard  method  for  reduc¬ 
ing  the  effects  of  the  plant  delay  on  the  filtered-X  LMS 
algorithm’s  operation  and  the  resulting  LMS  algorithm  for 
active  noise  control  [20],  [21].  Considering  the  single-channel 
filtered-X  LMS  adaptive  controller,  it  is  seen  from  (2)  that 
the  error  signal  e(n)  depends  on  the  outputs  y(n  -  m)  of 
the  controller  at  different  time  instants,  which  in  turn  depend 
on  the  controller  coefficients  wi(n  -  m)  at  different  time 
instants.  Because  the  plant  is  typically  causal,  past  coefficients 
are  employed  within  the  gradient-based  updates,  causing  a 
decrease  in  the  performance  of  the  system  not  unlike  that 
observed  for  the  delayed  LMS  algorithm  [31].  It  is  possible 
to  largely  mitigate  the  effects  of  this  delay  by  computing 
a  delay-compensated  error  signal  that  depends  on  the  most- 
recent  coefficients  wi(n).  Fig.  2  shows  the  block  diagram  of 
this  system,  in  which  7 (k)  is  the  delay-compensated  error 
signal  given  by 

(  M  \  L  — 1 

lin)  =  S  e(n)  -  ^  hmy{n  -  m)  >  +  wi(n)f(n  -  l) 

l  m= 1  J  1=0 

(34) 

where  the  term  within  brackets  on  the  RHS  of  (34)  is  nearly 
the  same  as  the  unattenuated  noise  signal  d(n)  if  the  estimated 
impulse  response  hm  accurately  models  the  unknown  plant’s 


impulse  response.  The  LMS  algorithm  for  active  noise  control 
uses  7 (k)  to  update  the  coefficients  [20],  [21]  as 

wi(n  +  1)  =  wi(n)  -  p(k)^(k)f(n  -  /).  (35) 

This  algorithm  requires  a  total  of  3 L  +  2 M  +  1  MAC’s  per 
iteration  to  implement,  and  it  uses  2L-f  M+max{L,  M+ 1}  + 
1  memory  locations.  Note  that  this  algorithm’s  performance 
depends  on  how  well  the  estimated  plant  impulse  response 
models  the  physical  response  of  the  plant.  As  our  focus  is 
on  implementation  and  not  performance  issues,  a  performance 
analysis  of  the  multichannel  LMS  algorithm  for  active  noise 
control  is  beyond  the  scope  of  this  paper. 

We  can  easily  extend  the  above  algorithm  to  the  multi¬ 
channel  case.  In  this  situation,  we  compute  the  K  delay- 
compensated  error  signals 

j  M 

7(k)(n)  =  e(k)(n)  -  h£k)y(j)(n  -  m) 

j—1  m~l 

+  EEE  Wf’j)(n)/(i’>-fc)(n  -  l)  (36) 

i  =  l  j=l  1=0 

at  which  point  p(n)^k\n)  is  used  in  place  of  e^\n)  in 
(23).  Unfortunately,  this  modification  adds  IJKL  +  JKM 
MAC’s  per  iteration  to  the  overall  requirements  of  the  adaptive 
system  if  the  necessary  /(*»*'»  *)(n)  values  are  available,  and  it 
adds  IJKL  +  (21  +  1  )JKM  MAC’s  if  fc)(n)  must  be 
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computed.  In  addition,  the  storage  requirements  for  the  overall 
system  are  significantly  increased  if  the  modification  is  applied 
to  the  fast  multichannel  filtered-X  LMS  algorithm  in  Table  I. 


B.  New  Implementations 

1)  A  Multichannel  Extension  of  an  Existing  Algorithm:  In 
[23],  a  method  is  presented  for  reducing  the  complexity  of 
the  single-channel  LMS  algorithm  for  active  noise  control 
when  the  secondary  path  length  M  is  less  than  a  third  of 
the  controller  filter  length  L.  We  now  extend  this  algorithm  to 
the  multichannel  case.  Define 

7<n)(n)  =M(n)7(fc)(n) 

{J  M 

e(fc)(n)  +  X  X  h&'k)uV>{n-  1) 

j  =  l  m—  1 


(37) 


where  uii\n)  is  defined  as 
v$(n)  =y^(n  -  m) 

I  L- 1 

Y,  w[iJ){n  +  l)x^(n-l-m).  (38) 

i= I  1-0 

Using  algebraic  manipulations  similar  to  those  in  [23],  an 
update  for  u$(n)  is  found  to  be 


umHn)  = 


if  m  =  1 

k-1 

“m-l(n  ~  1) 


X!  Pm- 1  (n)7Mfc) («)>  if  2  <  m  <  M 

(39) 


fc=l 


where  pm  *  (n)  is  defined  as 

/  L— 1 


p%k\n)  =  XX  *(<)(»  -  1  ~  ™)f(i'j'k\n  ~  0-  (4°) 

1=0 

Note  that  pm’ fe)  (n)  can  be  updated  as 

p£fc)(n)  =p^’fc)(n  -  1)  +  X  {*(%  -  m)f^j’k)(n) 

1  =  1 

(n  -  m  fc) (ri  -  Z.) }  (41) 


which  greatly  reduces  the  number  of  operations  needed  for 
the  algorithm  when  L  is  large.  This  update  also  reduces  the 
amount  of  memory  required  for  the  algorithm,  as  f^^k\n) 
and  /(*• fc)(n  —  £,)  can  be  computed  at  each  iteration  to  avoid 
storing  fc)(n  —  l)  for  1  <  /  <  L  —  1. 

Collecting  (37),  (39),  and  (41),  we  obtain  a  multichannel 
delay  compensation  technique  that  requires  (4 1  -1-  2 )JKM 
MAC’S  per  iteration  and  (/  +  J  4-  JK)M  memory  locations 
to  implement  when  L  >  M,  assuming  that  /(*»J*fc)(n)  and 
_  £)  are  computed  at  each  iteration.  Comparing 


these  complexity  requirements  with  those  of  the  original  delay 
compensation  technique,  if 

L>  ^2  +  (42) 

then  this  new  technique  is  more  computationally  efficient.  The 
new  technique  also  has  low  memory  requirements  and  thus  is 
an  ideal  match  to  the  fast  algorithm  in  Table  I. 

2)  An  Alternate  Implementation:  Although  useful,  the 
delay-compensation  method  in  (37),  (39),  and  (41)  can  be 
prohibitive  to  implement  when  the  number  of  channels  is  large, 
as  its  complexity  grows  as  O(IJKM).  We  now  consider 
an  alternate  implementation  that  uses  many  of  the  existing 
quantities  within  the  efficient  multichannel  filtered-X  LMS 
algorithm  in  Table  I  while  avoiding  the  formation  of  the 
filtered  input  signal  values.  For  this  derivation,  consider  the 
definition  of  p^,fc)(n)  in  (40).  Substituting  the  expression 
for  /(»•■*' *>(n)  in  (22)  into  the  RHS  of  (40)  and  rearranging 
terms,  we  obtain 

P(ifc)(n) 

M  ( L- 1  I 

-XaHxX*^" 

q—  1  U= 0  i—  1 

=  X  h{j'k)rm-q{n  -  q) 

q-1 

where  rm(rt)  is  as  defined  in  (32).  From  the  definition  of 
rm(n),  it  is  straightforward  to  show  that 

rm-q(n  -  q)  =  rq.m{n  -  m)  (44) 

and  thus  the  necessary  values  of  rm-q(n  -  q)  to  represent 
pm  ^(n)  can  be  obtained  from  rm(n),  0  <  m  <  M  by  storing 
delayed  values  of  these  quantities.  Define 

K 

cm\n)  =  hm  k)  (n)lj!c)  in)  ■  (45) 

fc=l 

Note  that  cf}  (n)  appears  in  the  update  for  e„  (n)  in  (33)  when 
the  delay  compensation  technique  is  combined  with  the  fast 
filtered-X  LMS  algorithm;  thus,  it  is  already  available.  Then, 

X  Pm- l(nHk)(n)  =  X  c(qjHn)rm-i-q(n  -  q)  (46) 

fc= 1  q= 1 

and  the  RHS  of  (46)  can  replace  the  summations  on  the  RHS 
of  the  updates  for  Um\n)  in  (39). 

Table  V  lists  the  operations  for  this  alternative  form  of  the 
LMS  algorithm  for  multichannel  active  noise  control.  This 
algorithm  requires  J K M + J(M  +1){M ~  1)  more  MAC’s  per 
iteration  than  does  the  filtered-X  LMS  algorithm  in  Table  I.  If 

M-jj<  (4 /  +  1  )K  (47) 

then  this  implementation  is  more  computationally  efficient 
than  that  in  (37),  (39),  and  (41).  If 

M  <  IK  +  \JTkL  +  I2tf 2  +  1 


-  I  —  m)x(',\n  —  l  —  q) 


(43) 


(48) 
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TABLE  V 

A  Multichannel  LMS  Algorithm  with  Reduced  Complexity  for  Active  Noise  Control 


Equation 


MACs 


for  m  =  0  to  M  do 

/ 

rm(n)  =  rm(n  —  1)  +  {x^(n)z(,J(n  -  m)  -  z(,)(n  -  L)x^l)(n  -  L  -  m)| 

i=i  k 

end 

for  k  =  1  to  A  do 

(  J  M 

-rik\n)  -  n(n)  l  i<*>(n)  +  j]  jC  _  1) 

{  ;  =  lm=l 

end 

for  j  —  1  to  J  do 

j/j)(n)  =  “  Yle<m(n  -  !)r>n+l(n) 

i=l  1=0  m=  1 

#\n)  =  prVk\n) 

$\")  =  ef\n) 
for  m  =  1  to  M  —  1  do 

cm+l(n)  =  E^M*Hn) 

fc=i 


em+l(")  =  em  ("-  !) +cmil(n) 


) 


end 


AT 


for  m  =  1  to  M  -  1  do 

um+l(n)  =  ~  1)  “  ’)(")rm-,(n  -  ?) 

1=1 

end 

for  i  =  1  to  I  do 

for  l  =  0  to  L  —  1  do 

+  1)  =  -  e^(n)ar^^(n  —  M  —  l) 

end 
end 
end 


2/(M  +  1) 

JA'M  +  A 

+  -  1) 

JK 

JK(M  -  1) 
JM 

JM 

JM(M  -  1) 

IJL 


Total:  2/JZ>  4-  2,7 AM  +  (2/  +  JM)(M  +  1)  +  A 


then  this  implementation  is  more  computationally  efficient 
than  the  standard  implementation  in  (36).  Considering  the 
system  configurations  listed  in  Tables  II-IV,  we  find  that  the 
algorithm  in  Table  V  is  the  most  computationally  efficient 
method  out  of  the  three  delay-compensation  techniques  con¬ 
sidered  when  IK  >  7,  IK  >  5,  and  IK  >  8,  respectively.  For 
the  remaining  configurations,  the  standard  delay-compensation 
implementation  combined  with  the  new  filtered-X  LMS  up¬ 
date  method  in  Table  II  is  the  most  efficient,  although  the 
method  in  (37),  (39),  and  (41)  is  the  most  efficient  for  the 
configurations  in  Table  II  if  the  controller  filter  length  is 
increased  to  L  =  75. 

Remark:  These  implementations  of  the  multichannel  LMS 
adaptive  controller  modify  the  filtered-X  LMS  adaptive  con¬ 
troller  by  including  the  summation  within  brackets  on  the 
RHS  of  (37)  and  the  supporting  updates  for  Since 

Um\n)  is  of  0(/x(n)),  the  performance  difference  between 
the  two  multichannel  LMS  algorithms  and  the  filtered-X  LMS 
algorithm  can  only  be  expected  to  be  significant  for  large 
stepsizes.  Note  that  the  filtered-X  LMS  algorithm  is  typically 
derived  assuming  “slow  adaptation,”  so  that  the  derivatives 
of  the  error  signals  with  respect  to  the  filter  coefficients  can 
be  easily  calculated  [11].  Our  multichannel  LMS  algorithms 


quantitatively  define  the  difference  between  the  filtered-X 
LMS  and  LMS  coefficient  updates  and  provide  an  alternative 
justification  for  the  former  algorithm  for  situations  in  which 
the  stepsize  is  small-valued. 

V.  Simulations  and  Numerical  Issues 

In  this  section,  we  consider  the  effects  that  numerical  errors 
due  to  finite  precision  calculations  have  on  the  performances 
of  the  new  implementations  of  the  filtered-X  LMS  and  LMS 
algorithms  for  active  noise  control.  One  important  feature 
of  the  LMS  algorithm  in  adaptive  filtering  is  its  robust  be¬ 
havior  in  the  presence  of  various  approximations  and  errors 
that  are  often  introduced  in  a  real-world  implementation. 
Since  the  original  implementation  of  the  filtered-X  LMS 
algorithm  and  the  adjoint  LMS/CPFE  algorithm  are  variants 
of  stochastic  gradient  methods  [16],  they  share  many  of  the 
robust  convergence  properties  of  the  LMS  algorithm.  The  new 
implementations  of  the  filtered-X  LMS  and  LMS  algorithms 
apply  one  or  more  forms  of  delay  compensation  to  the  adjoint 
LMS/CPFE  algorithm.  As  such,  the  numerical  properties  of 
the  delay  compensation  techniques  are  of  immediate  interest, 
particularly  as  they  affect  the  long-term  performances  of  the 
systems. 
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Fig.  3.  Simulated  performance  on  air  compressor  noise  for  the  original 
filtered-X  LMS  and  original  LMS-ANC  algorithms. 


While  formal  analyses  of  the  numerical  properties  of  the 
delay  compensation  techniques  used  in  our  implementations 
are  beyond  the  scope  of  this  paper,  extensive  simulations  of  the 
implementations  have  indicated  that  the  robust  numerical  prop¬ 
erties  of  the  underlying  stochastic  gradient  algorithms  are  not 
fundamentally  altered  in  our  new  implementations.  These  be¬ 
haviors  are  quite  unlike  those  of  fast  RLS/Kalman  techniques 
that  exhibit  an  exponential  instability  unless  careful  measures 
are  taken  [32],  [33].  The  only  possible  source  of  numerical 
difficulty  is  the  method  for  calculating  rm(n)  in  (32),  as  this 
update  is  marginally  stable.  Thus,  numerical  errors  in  rm(n) 
can  grow  linearly  over  time  in  a  finite-precision  environment, 
particularly  in  floating-point  realizations  in  which  relatively- 
few  bits  are  allocated  for  the  mantissas  of  the  terms  used  to 
update  each  rm(n).  Fortunately,  the  growth  in  these  errors 
can  be  easily  prevented  using  several  well-known  procedures. 
Perhaps  the  simplest  procedure  is  to  periodically  recalculate 
rm(n)  using  its  definition  in  (31),  a  procedure  that  requires 
extra  additions  and  memory  locations.  Moreover,  because  each 
rm(n)  has  a  finite  memory  by  definition,  accumulating  and 
copying  its  value  to  the  appropriate  memory  location  within 
the  controller  causes  no  performance  penalty,  unlike  periodic 
restart  methods  in  exponentially  windowed  fast  RLS/Kalman 
filters  [32].  Another  solution  is  to  introduce  a  leakage  factor 
into  the  calculation  of  rm(n).  One  particularly  useful  method, 
described  in  more  detail  in  [34],  is  in  (49),  shown  at  the  bottom 
of  the  page,  where  A  is  slightly  less  than  one.  This  method 
alters  the  value  of  rm(n)  slightly,  but  for  values  of  A  close 
to  one,  the  errors  introduced  into  the  calculations  for  y(n )  do 


not  significantly  affect  the  overall  behaviors  of  the  respective 
systems.  Moreover,  the  update  in  (49)  adds  only  M  MAC’s 
and  a  single  comparison  to  each  systems’  overall  complexity. 

Figs.  3-5  plot  the  envelope  of  the  sum-of-squared  errors 
Y^k=\  {e(fc)(n)}  f°r  a  total  °f  seven  different  four-input, 
three-output,  four-error  active  noise  control  algorithms  with 
L  =  M  =  50  as  applied  to  air  compressor  data  measured 
in  an  anechoic  environment  [35].  In  this  case,  all  calculations 
were  performed  in  the  MATLAB  floating-point  environment, 
and  the  approximate  sampling  rate  of  the  data  was  4  kHz. 
Stepsizes  for  each  algorithm  were  chosen  to  provide  the  fastest 
convergence  on  this  data  while  yielding  approximately  the 
same  steady-state  error  power  due  to  limits  in  noise  modeling 
error.  Fig.  3  shows  the  unattenuated  air  compressor  noise 
signal,  in  which  the  bursty  nature  of  the  compressor  noise  is 
clearly  evident,  along  with  the  average  error  power  envelopes 
of  the  original  filtered-X  LMS  and  LMS  algorithms  applied  to 
this  data,  in  which  the  stepsizes  for  each  algorithm  were  chosen 
as  ^  =  0.1  and  //  =  0.2,  respectively.  Shown  for  comparison 
in  Fig.  4  are  the  average  error  power  envelopes  of  the  adjoint 
LMS/CPFE  algorithm,  the  fast  filtered-X  LMS  algorithm  in 
Table  I,  and  the  new  multichannel  LMS  algorithm  in  Table  V, 
in  which  the  stepsizes  for  each  algorithm  were  chosen  as  fx  = 
0.05,  \x  —  0.1,  and  \i  =  0.2,  respectively.  As  can  be  seen,  the 
fast  multichannel  filtered-X  LMS  algorithm  outperforms  the 
adjoint  LMS/CPFE  algorithm  in  its  convergence  rate,  and  the 
multichannel  LMS  algorithm  performs  the  best  of  the  three  due 
to  the  lack  of  coefficient  delay  within  the  parameter  updates. 
In  addition,  the  differences  in  the  error  signals  between  the 
original  and  fast  algorithms  in  Figs.  3  and  4  were  found  to  be 
about  ten  times  the  order  of  the  machine  precision  used  in  the 
simulation  («10“16)  after  60000  iterations.  A  linear  growth 
of  the  numerical  errors  was  apparent,  however. 

Shown  in  Fig.  5  are  the  behaviors  of  the  fast  multichannel 
filtered-X  LMS  and  fast  multichannel  LMS  algorithms  in 
which  the  leakage-based  update  for  rm(n)  in  (49)  is  employed, 
where  A  =  0.999.  Comparing  the  average  error  powers  with 
those  of  the  corresponding  algorithms  in  Fig.  4,  no  discernible 
differences  in  performance  can  be  seen.  In  fact,  the  actual 
differences  between  the  errors  of  the  corresponding  systems 
were  less  than  2  x  10“ 10  in  magnitude  in  this  example — a 
negligible  difference — and  no  growth  in  the  numerical  errors 
of  rm(n)  was  observed.  Thus,  the  method  in  (49)  can  be 
used  to  stabilize  the  marginal  instability  of  the  sliding-window 
rm(n)  updates  without  altering  the  observed  performances  of 
the  proposed  systems. 

VI.  Conclusions 

We  have  described  new  implementations  of  the  multichan¬ 
nel  filtered-X  LMS  and  LMS  algorithms  for  feedforward 
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x  i<r* 


Fig.  4.  Simulated  performance  on  air  compressor  noise  for  the  adjoint 
LMS/CPFE,  fast  filtered-X  LMS,  and  fast  LMS-ANC  algorithms. 


x  10"* 


Fig.  5.  Simulated  performance  on  air  compressor  noise  for  the  stabilized  fast 
filtered-X  LMS  and  stabilized  fast  LMS-ANC  algorithms. 


active  noise  and  vibration  control  tasks.  These  implementa¬ 
tions  provide  the  same  input-output  behaviors  of  the  original 
implementations  while  requiring  only  a  fraction  of  the  com¬ 
putational  effort  and  memory  of  the  original  implementations. 
Because  of  the  pervasiveness  of  stochastic-gradient-based  al¬ 
gorithms  for  active  noise  and  vibration  control  systems,  the 
new  implementations  are  expected  to  have  a  significant  impact 
on  the  practicality  and  cost  of  these  schemes  in  real-world 
applications. 
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ABSTRACT 

The  performance  of  the  normalized  least- mean- 
square  (NLMS)  adaptive  filter  in  acoustic  echo  can¬ 
cellation  can  be  improved  using  decorrelation  filters 
in  the  adaptation  paths.  This  modification  typ¬ 
ically  increases  the  complexity  of  the  overall  sys¬ 
tem  by  about  50%,  however,  and  the  system’s  mem¬ 
ory  requirements  are  also  increased.  In  this  paper, 
we  provide  four  novel  efficient  implementations  of 
the  NLMS  acoustic  echo  canceller  with  decorrela¬ 
tion  filters  whose  complexities  are  nearly  the  same 
as  that  of  the  standard  NLMS  adaptive  filter  for 
short  decorrelation  filter  lengths.  Two  of  these  im¬ 
plementations  also  save  on  memory  use  over  the 
standard  implementation.  The  algorithms  are  di¬ 
rect  extensions  of  delay-compensation  methods  for 
feedforward  active  noise  control  systems. 


1.  INTRODUCTION 

In  acoustic  echo  cancellation  for  hands-free  telephony,  the 
impulse  response  of  a  loudspeaker-enclosure-microphone 
(LEM)  system  is  estimated  and  used  to  electronically- 
remove  the  far-end  speech  component  emitted  by  the  loud¬ 
speaker  from  the  near-end  speech  signal  collected  at  the 
microphone.  We  can  express  the  enhanced  speech  signal  as 

e(fc)  =  y(k)  -  y(k),  (1) 

where  y(k)  is  the  microphone  signal  and  y(k)  is  an  estimate 
of  the  far-end  speech  component  within  this  signal.  Typ¬ 
ically,  an  adaptive  finite-impulse-response  (FIR)  adaptive 
filter  is  used  to  calculate  y(k)  as 

y{k)  =  c  T(k)x(k),  (2) 

where  c(k)  =  (co(fc)  •••  c,v-i(fc)]T  is  the  estimated  LEM 
impulse  response  at  time  k  and  x(k)  =  [x(k)  *  •  *  x{k  —  iV  + 
1)]T  axe  the  most-recent  N  samples  of  the  far-end  speech 
signal  at  the  loudspeaker’s  output.  The  goal  is  to  calculate 
c(&)  such  that  the  magnitude  of  e(k)  is  minimized  over  time. 

The  normalized  least-mean-square  (NLMS)  adaptive  fil¬ 
ter  is  perhaps  the  most-popular  system  for  acoustic  echo 
cancellation  due  to  its  simplicity  and  robust  behavior. 
This  adaptive  filter  is  slow  to  converge  in  this  applica¬ 
tion,  however,  due  to  the  correlated  nature  of  the  far-end 
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Fig  1:  NLMS  acoustic  echo  canceller  employing 
decorrelation  filters. 

speech  signal  x(k).  One  method  to  improve  the  behav¬ 
ior  of  NLMS  in  this  application  is  shown  in  Fig.  1  [1]- 
[4],  in  which  two  decorrelation  filters  with  impulse  response 
f  =  [fo  •  •  •  /M-i]T  are  used  to  prefilter  x(k)  and  y(k)  as 

x/(k)  -  fTx(k)  and  y / (k)  =  fT y(k) ,  (3) 

where  x(^)  —  [z(&)  *  *  *  x(k  —  M  +  1)]T  and  y (k)  = 
[y(k)  •  •  •  y(k  -  M  4-  1)]T,  respectively.  The  values  in  f  are 
chosen  such  that  x/(k)  is  approximately  decorrelated;  that 
is,  E{xf(k)xf(k-l)}  a  5(0,  where  E{-}  denotes  statistical 
expectation.  Then,  c(k )  is  updated  as 


c(k  + 1) 

(4) 

e/(fc) 

=  Vf{k)  —  Vf(k) 

(5) 

Vf{k ) 

=  cT(k)x.f(k), 

(6) 

where  xf(k)  =  [x/(k)  ■  --xf(k-N  +  1)]T  and  //(fc)  is  a  step 
size  in  the  range  0  <  jx(k)  <  2. 

For  typical  speech  signals,  the  above  algorithm  outper¬ 
forms  the  standard  NLMS  algorithm  in  acoustic  echo  can¬ 
cellation,  and  the  improvement  is  significant  even  for  fixed 
decorrelation  filters  as  short  as  M  =  2  taps  [4].  As  M  can 
be  much  less  than  the  echo  canceller  length  JV,  the  calcula¬ 
tion  of  x/(k)  and  y/(k)  in  (3)  do  not  add  significant  com¬ 
plexity  to  the  overall  system.  Because  y(k)  in  (2)  needs  to 
be  computed  for  the  echo  canceller’s  output,  however,  this 
algorithm  requires  about  3 N  +  2 M  multiply/accumulates 
(MACs)  per  iteration,  which  is  more  than  a  50%  increase 
in  complexity  over  the  standard  NLMS  algorithm  that  uses 
only  2 N  MACs  per  iteration.  Moreover,  this  algorithm  also 
requires  more  memory  than  the  standard  NLMS  algorithm, 
as  both  x(k)  and  x/(&)  must  be  stored. 


In  this  paper,  we  present  four  efficient  implementations 
of  the  NLMS  algorithm  with  decorrelation  filters  that  are 
mathematically-equivalent  to  (l)-(6).  The  algorithms  are 
direct  extensions  of  delay-compensation  methods  for  feed¬ 
forward  active  noise  control  systems  [5]— [8]  that  use  correc¬ 
tion  terms  to  determine  y/(k)  in  (6)  from  the  value  of  y(k)  in 
(2).  Each  of  the  implementations  only  require  2 N  -b  O(M) 
MACs  per  iteration;  as  such,  they  are  simpler  than  the 
standard  implementation  for  M  -C  N.  Moreover,  two  of 
the  implementations  do  not  require  storing  x/(ft),  thus  re¬ 
ducing  the  memory  requirements  of  the  implementation  as 
well.  Tables  of  each  of  the  implementations  are  provided, 
and  overall  comparisons  of  the  algorithms’  computational 
and  memory  requirements  axe  given. 

2.  THE  METHOD 

We  first  outline  the  methodology  behind  the  new 
computationally-efficient  implementations.  More  details 
about  these  methods  in  the  context  of  feedforward  active 
noise  control  can  be  found  in  [5]-[8].  Define  y/(fc)  as 

y/(k)  =  fy(k),  (7) 

where  y (k)  =  [y(fc)  •  •  •  y(k  —  M  +  1)]T.  Then,  y/(k)  in  (6) 
can  be  calculated  from  y*f  (k)  as 

Vf(k)  =  Vfik)  +  t(k),  (8) 

where  the  correction  term  t(k)  is  defined  as 

t(k)  =  cr(A;)x/(fc)  -  fTy{k)  (9) 

N~i  M-l 

=  ^  cn(k)x/(k  -  n)  -  ^  fmy(k  -  m).  (10) 

71=0  m- 0 

We  can  expand  t(k)  in  (10)  using  (3)  and  (4)  as 


Table  Is  Algorithm  Cl 


r~“  Equation 

MAUT 

yf(k)=i1y(k) 
y(k)  =  c  T{k)x(k) 
e(k)  =  y(k)  -  y(k)~ 

Vf(k)  =  fry(fc)  +  fTu(fc  - 1) 

xr(k)  —  fTx(k) 

p(k)  =  p(k-l)  +  \xf(k)\*-\x,(k-N)\l 

Txf(k)  =  r*/(fc-l)  +  x(k)xe(k)  -  x(k-N)x/(k-N) 
eM(fc)  =  p(k)  [y/{k)  -  ?/(*)]  /p(k) 

u(k)=  +  efl(k)rxf(k) 

c(k  4-  1)  =  c(Ar)  +  ea(k)Kf(k) 

U 

N 

1 

2M  -  1 

U 

2 

2M  —  2 
l(l-) 

Af  -  1 

N 

|  Total:  2N  -r  7M(  1-r)  .  J 

Algorithm  Cl:  Remite  t(k)  in  (11)  as 

M-l  i 

m  =  YfiJ2e^k~m) 

i=  1  m=l 

iV-1 

*  ^  x(k  -  j  -  i)x/(k  -  j  -  m)  (12) 

j=0 

M-l  i 

—  ^  fi  ^  6{j.(k  Tn^Tx  f  ,i  —  m  {k  TTi) ,  (13) 

i=  1  m=l 

where  we  have  defined 

2V-1 

rxf,i{k)  =  ^  x(k  —  j  -  i)xf(k-j).  (14) 

i-  o 

By  defining  rx/(  k)  =  [rxf,o(k)  •••  rx/,.v/-2(&)]T  andu(^)  = 
[tii(fc)  •••  u-v/-i(fc)]T  where 


M- 1  JV-l  i 

f(fc)  =  £  /i 

i=l  j=0  m=l 

M-l 

■  f*x(k  -  j  -  m -  n),  (11) 

71=0 

where  eM(fc)  =  fi(k)e/(k)/x.J(k)'Xf(k).  By  alternating  the 
order  of  summations  on  the  RHS  of  (11),  we  can  obtain 
many  different  ways  of  computing  t(k ),  and  as  shown  in  [6], 
several  of  these  are  of  O(M)  complexity  per  iteration.  Thus, 
y/(k)  can  be  computed  from  y(A:)  using  only  0{M)  MACs 
per  iteration,  and  the  overall  complexity  of  the  system  is 
therefore  2N  -r  O(M)  MACs  per  iteration. 


3.  COMPUTATIONALLY-EFFICIENT 
IMPLEMENTATIONS 


The  new  algorithm  implementations  can  be  divided  into 
two  classes:  those  that  use  x/(fc)  directly  within  the  coef¬ 
ficient  updates,  and  those  that  do  not.  The  former  class  of 
algorithms,  denoted  as  Class  “C” ,  are  the  simplest  compu¬ 
tationally,  whereas  the  latter  class,  called  Class  “M”,  use 
somewhat  less  memory.  Within  each  class,  there  are  two 
implementations  that  are  about  the  same  complexity  per 
iteration.  We  now  derive  these  algorithms. 


m(k)  =  ^  e^jk  —  m  -b  1  )rxf%i-m(k  —  m  4- 1),  (15) 

771=1. 


we  can  express  (13)  as 


M-l 

t(Jfe)  =  Y,  -  1)  =  fTu(fc-l),  (16) 

1=1 


where  f  =  [/i  ■  •  •  /m-i]T  contains  the  last  M  -  1  elements 
of  f.  Furthermore,  it  can  be  easily  shown  that 

u(fc)=[  2(jfc°-i)  ]  +e»(k)r*f(k)  (17) 

rxf(k)=vzf(k  -  1)  +x{k)x/(k)  -  x(k  -  N)x/(k  -  NQl 8) 

where  u (k)  contains  the  first  M  —  2  elements  of  u (k)  and 
x(fc)  =  [x{k)  *  •  •  x(k  —  Af  4*  2)]T.  From  (16)-(18),  we  can 
compute  y/{k)  in  (8)  from  y(k)  using  only  about  5 M  MACs 
at  each  time  step.  Table  1  lists  the  entire  algorithm;  its 
overall  complexity  is  2 N  4-  1M  MACs  and  one  divide  per 
iteration. 


Table  2:  Algorithm  C2 


Equation 

mmxm n 

yf(k)  =  fy(fc) 

M 

y(fc)  =  cT(fc)x^) 

N 

e(fc)  =  p(fc}^-  y(fc) 

Vf(k)  =  Vy(k)  +  PT(k  -  l)e(*  -  1) 

1 

2M-1 

xt(k)  =  x^(k  -  1)  +  fox(k) 

**">(*)  =  *<">(* -JV)  =  0 

1 

0 

for  j  =  M  -  1  to  1  step  (-1)  do 

J-p{k)  =  X(j+1)(k)  +  fjX(k  —  j  +  1) 

Jj\k-N)  =x<j+1)(k-N) 

M-l 

+  fjx(k  —  j  —  N  +  1) 

M-l 

Pj(fc)  =pj(k  -  1)  +x/(k  -j+  l)xy\k) 

-xf(k-j-N  +  l)xY>(k-N) 

2M  -2 

end  _ 

p(k )  =  p{k  - 1)  +  |x/(fc)|2  -  |*/(k  -  ^")l2 

2 

e^(fc)  =  p{k)  [y;(k)  -y/(k)]  /p(k) 

1(1+) 

^[e^l)] 

0 

c(A:  +  1)  =  c  (k)  +  eu(k)xf  (k) 

N 

Total:  21V  +  7M(1+) 


Algorithm  C2:  Define  p (k)  =  [pi (fe)  •••  PM-i(k)]T 
where 

N-l  M-l 

Pm(k )  =  ^  Xf(k-  j  -m  +  1)  fix{k-j  -  i  +  1).  (19) 

j  — 0  i=rn 

Then,  it  can  be  shown  that  [6] 

M-l 

t(k)  =  ^  Pm(A;  -  l)eAi(fc  -  m)  =  pT(fc  -  l)e(fc  -  1),  (20) 

m=l 

where  e(fc)  =  [eM(fc)  •  •  •  eM(fe  -  M  +  2)]T.  Furthermore,  by 
defining 

M-l 

xp\k)  =  fiX(k-i  +  l),  (21) 

i=m 

for  0  <  m  <  M  —  1,  pm(k)  and  x^\k)  can  be  updated  in 
an  order-recursive  fashion  as 


Table  3:  Algorithm  Ml 


Equation 

■ygaaii 

yJW^FW)  ' 

r  Xx(k)  =  TXx(k  —  1)  +  x(k  —  l)x(fc) 
-5c(fc-iV-l)x(fc-iV) 
y(k)  =er(k)x(k)  +r£x(k)S(k  -  1) 
e(k)  =  y(k)  -  y(k)~ 

Vf{k)  =  fr£(fc)  +  fTu(fc  -  1) 

Xf(k)  =  fTx(fc) 

xf(k  -  N)  =  fTx(fc  -  AT) 

P(k)  =  p(k  -  X)  +  |x/(fc)|2  -  \xr(k  -  JV)|2 

rxf(k)  =  rxf(k-l)  +  x(fc)x/(fc)  -  x(fc-iV)x/(fc- N) 

e»(k)  =  /i(fc)  [y/(&)  -  y/(k)]  /p(k) 

m  =  [  i)  ]  +£e/.(fe) 

u(^)=  [u(ife  —  1)]  +  eii[k)rxf(k) 

c(k  J- 11  =  c(k)  +  ew_i  (k)x(k  -M  +  1) 

M 

2M-2 
iV+M— 1 
1 

2M  —  1 

M 

M 

2 

2M  —  2 
1(1+) 

M 

M-l 

N 

iitfflEiaBflcattfii 

vector  x(k)  for  coefficient  updates.  These  methods  com¬ 
bine  the  adjoint  LMS/CPFE  algorithm  in  [9.  10],  a  delay- 
compensation  technique  used  in  the  fast  affine  projection 
(FAP)  algorithm  [11,  12],  and  the  procedures  outlined  pre¬ 
viously.  For  derivations  of  similar  algorithms  used  in  active 
noise  control,  see  [7,  8].  a 

Define  an  auxiliary  coefficient  vector  c(k)  as 

c(k)  =  c(k)  —  X(fc  —  l)£(fc  —  1),  (24) 

where  X(fc)  contains  the  first  M  —  1  columns  ofthe  (N  x  M) 
matrix  X(&)  =  [x(fc)  •  •  *x(A;  —  M  +  1)]  and  £{k)  contains 
the  first  M  —  1  elements  of  £(&)  =  [eo(&)  €,v/-i(fc)]T, 


defined  as 

m  so(k) 

£o(k  -  1)  +  Cl(fe) 

£(*)  = 

£o(A;  —  M  +  1)  4 - h  C,v/-l(^) 

Cm(k)  — 

It  is  easily  shown  that  c (k)  in  (24)  has  the  update 

c(fe  +  l)  =  c(k)  +  eM-i(k)x(k  -  M  +  1).  (27) 

In  addition,  £_{k)  can  be  updated  using 


Pm(fc)  =  Pm(fc-l)  +  x/(fc-rn  +  l)a;ym)(fc) 

—  x/(k  —  m  —  N  +  l)xf]  ( k  -  N)  (22) 

(  fM-ix(k  -  M)  if  m  =  M  -  1 
x(fm)(k)  ={  x(fm+1)(k)  +  fmx(k-rn  + 1)  (23) 

I  if  771  <  M-l. 


m 


0 

S(k  -  1) 


+  feM(fc). 


(28) 


The  output  y(fc)  can  be  calculated  from  the  auxiliary  co¬ 
efficient  vector  and  a  properly-defined  correction  term.  Pre¬ 
multiplying  both  sides  of  (24)  by  xT(fc)  gives  the  relation 


From  (20),  (22),  and  (23),  we  can  again  compute  y/{k)  in 
(8)  from  y(k)  using  about  5 M  MACs  per  iteration.  Table  2 
lists  the  operations  of  this  implementation  that,  like  Algo¬ 
rithm  Cl,  requires  only  2 N  +  7 M  MACs  and  one  divide  per 
iteration  to  implement. 

Algorithms  Ml  and  M2:  Both  Algorithms  Cl  and 
C2  use  the  filtered  input  signal  vector  x/(k)  to  update 
c (k)  at  each  time  instant.  W  now  develop  two  alternative 
equivalent  updating  strategies  that  employ  the  input  signal 


y(k)  =  cT  (k)x(k)  +  xT  (k)X(k  —  l)£(fc  —  1).  (29) 
Define  vxx(k)  =  [n(fc)  •  •  •  rAf_i(fe)]T,  where  rm( k)  is 

N-l 

rm(k)  =  x(k  —  n  —  m)x(k  —  n).  (30) 

n= o 

Then,  we  can  rewrite  (29)  as 

y(k)  =s  cT(k)x(k)  +  r^x(k)£(k  -  1),  (31) 


Table  4:  Algorithm  M2 


Eauation 

MACs  ‘ 

y/W  =  t^y(k) 

rxx(k)  —  v xx(k  -  1)  +x(fc  -  l)x(fc) 

—  x(k  —  N  —  l)x(k  —  N) 
y(k)  =^(A)x£fc)  +1T  (fc)£(fc  -  1) 
e{k)  -  y(k Y-  y(k) 
yf(k)  =  VV(k)  +  pT(k  -  l)e(fc  -  1) 

Xf{k)  =  x^(k  —  1)  +  fox(k) 

xt(k  —  N)  =  x^(k  —  N  —  1)  +  fox(k  —  N) 
x)M)(k)  =x<ff)(k-  N)=  0 
for  ?  =  Af  —  1  to  1  step  (-1)  do 

Xh.\k)=X(j+l\k)+IjX(k-i  +  1) 

J~p{k  -N)=  x(.j+1\k  -  N) 

+  fjx(k  -  j  —  N  +  1) 

Pj{k)  =  pj(k  -  l)  +  x/(k  -j  +  l)x(p(k) 
-xf(k-j-N  +  l)x{fj)(k-N) 

end 

P{k)  =  P{k  - 1)  +  M*)!2  -  |x f(k  -  iv)|2 

eM(fc)  =  p(k)  [yf{k)-y/{k)]  /p(k) 

£«  =  [  S{k-  1 
[  e{k  -  1) 

c (k  -fl)  =  cffc)  4*  eA/f-T  (k)x(k  —  Af  -f  1) 

M 

2M-2 
N+ Af-1 
1 

2Af  —  1 

1 

1 

0 

Af-  1 

Af-  1 

2Af  -  2 

2 

1(1*) 

Af 

0 

N 

Total:  2 N  +  11 M  -  2(14-)  1 

and  Txx(k)  can  be  computed  recursively  as 
Txx(k')  =  Vxx{k  l) 

-f  x(&  —  l)x(A;)  —  x(k  —  N  +  l)x(A:  -  N).  (32) 

^  Combining  (27)^  (28),  (31),  and  (32),  we  can  compute 
y(k)  and  update  c (k)  without  forming  the  vector  x/(k). 
Embedding  this  technique  within  Algorithm  Cl  and  Al¬ 
gorithm  C2,  one  obtains  Algorithm  Ml  and  M2  listed  in 
Tables  3  and  4,  respectively.  These  algorithms  require 
2 N  4*  12Af  —  3  and  2 N  +  11 M  -  2  MACs  per  iteration  to 
implement,  respectively. 

4.  SUMMARY  AND  CONCLUSIONS 

In  summary,  we  have  presented  four  mathematicallv- 
equi valent  implementations  of  the  NLMS  acoustic  echo 
canceller  with  decorrelating  filters  in  the  adaptation  loop. 
These  algorithms  are  straightforward  extensions  of  recently- 
developed  delay-compensation  methods  for  feedforward  ac¬ 
tive  noise  control  systems.  To  enable  a  quick  compari¬ 
son,  Table  5  lists  the  number  of  MACs  and  memory  loca¬ 
tions  that  each  algorithm  requires,  ignoring  constant  terms. 
From  this  table  we  see  that 

•  if  N  >  5 Af ,  Algorithms  Cl  and  C2  require  fewer  MACs 
as  compared  to  the  standard  implementation  at  the 
expense  of  slight  increases  in  memory,  and 

•  for  N  >  10 Af,  Algorithms  Ml  and  M2  require  fewer 
MACs  and  fewer  memory  locations  as  compared  to  the 
standard  implementation. 

In  addition,  we  can  make  the  following  remarks: 

Remark  #1:  Simulations  indicate  that  the  proposed  algo¬ 
rithms  enjoy  the  superior  numerical  properties  shared  by 
other  stochastic  gradient  adaptive  filters.  The  only  source 
of  numerical  difficulties  appear  to  be  the  marginally-stable 
sliding- window  updates  for  p(k ),  r3 ./(&),  and  rxx(fc).  If  nu¬ 
merical  error  accumulation  in  these  updates  is  a  problem, 


Table  5:  System  Requirements 


Algorithm 

Complexity 

(MACs) 

Memory 

Requirements 

Standard 
Algorithm  Cl 
Algorithm  C2 
Algorithm  Ml 
Algorithm  M2 

w  +  m 

2N  +  7M 
2N  +  7M 

2  N  +  12  M 

2  N  + 11 M 

W  +  :1M 

3N  +  6M 

ZN  +  7M 

2  N  +  8  M 

2  N  + 10  M 

they  can  be  periodically-restarted  with  only  a  small  increase 
in  memory,  or  some  form  of  leakage  can  be  introduced  [7], 

Remark  #2:  The  above  algorithms  have  been  derived  as¬ 
suming  that  the  decorrelation  filter  impulse  response  f  is 
time-invariant.  If  f  is  time- varying,  then  these  implementa¬ 
tions  are  not  guaranteed  to  produce  a  sequence  y(k)  that  is 
identical  to  that  of  the  standard  implementation.  Note  that 
it  is  possible  to  both  compute  y(k)  and  implicitly  update 
the  coefficient  vector  as 

c(k  +  1)  =  c  (k)  +  e^k(k)xffk(k)  (33) 

'.■*<*>  -  ;r afc) 

x/,*(*)  =  X(fc)f(&)  (35) 

by  an  algorithm  that  is  of  2 iV+  0(Af2)  complexity.  Partial 
details  of  such  an  algorithm  are  given  in  [6,  Table  1].  More¬ 
over,  if  f(Ar)  is  updated  by  an  algorithm  with  a  shift-input 
regressor  vector,  this  complexity  can  be  further  reduced. 
Additional  details  regarding  the  forms  and  performances  of 
these  algorithms  are  deferred  to  a  future  publication. 
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Abstract 

An  important  application  of  smart  materials  and  structures  is  the  control  of  periodic  disturbances  or  vibrations  j, 
environments  such  as  aircrafts  and  helicopters.  In  these  cases,  the  source  of  the  noise  is  a  rotating  machine,  so  that, 
arge  component  of  the  disturbance  is  periodic.  While  it  is  often  possible  to  take  measurements  on  the  machine  that  k 
the  source  of  the  periodic  disturbance,  concerns  of  reliability  and  maintainability  sometimes  make  such  measurements 
undesirable,  if  not  impossible.  Then,  the  problem  is  to  attenuate  a  periodic  disturbance  whose  frequency  is  unknown 
An  adaptive  algorithm  is  presented  m  this  paper  for  periodic  disturbance  attenuation,  using  the  concept  of  a  phase 
-locked  loop_  For  simplicity,  the  disturbance  is  assumed  to  be  sinusoidal.  An  approximate  analysis  is  performed  and  the 
results  are  found  useful  to  select  the  design  parameters.  Simulations  are  presented  that  demonstrate  the  ability  of  the 
a  gorithm  to  reject  sinusoidal  disturbances  with  unknown  frequency,  and  to  follow  signals  with  slowly  varvin^  magnitude 
and  frequency.  The  effect  of  measurement  noise  and  of  additional  disturbances  is  also  analyzed.  The 'results  provide 
numerical  measures  of  the  parameter  variations  and  of  the  loss  of  performance  in  the  presence  of  noise. 

Keywords:  adaptive  control,  signal  processing,  periodic  disturbances,  phase-locked  loops. 

1.  Introduction 

The  market  for  control  systems  that  actively  abate  unwanted  noise  and  vibration  is  rapidly  expanding.  Often,  the  source 
of  the  noise  is  a  rotating  machine  such  as  a  propeller  engine  in  an  aircraft  [1,  2]  or  a  fan  engine  in  a  ventilation  svstem 
*  ‘  "  S°me  *Ppllcati°ns;  active  control  is  useful  to  cancel  both  vibration  and  noise,  such  as  in  helicopters  [4]  -  [6]  With 
!  “r  Khat  aeedS  t0„be  rejected  C0ntains  a  !ar®e  social  component)  and  poU/y  a  few 
T1  A'  t  kThe  Pen°d  °f  he  d,‘S  UrbanCe  1S  USUally  not  known  exactl-v  and  may  even  vary  during  the  system’s  operation. 
The  disturbance  rejection  problem  is  more  complicated  when  measurements  cannot  be  taken  on  the  source  or  close  to  it, 
because  of  practical  considerations  (such  as  in  a  headset),  or  because  of  reliability. 

thS  P,aper’  We  preSent,aD  adaptlV€  COntro1  alS°nthm  for  the  rejection  of  sinusoidal  disturbances  with  unknown 
for  An/PPTmate’  1“efrlzed  analysls  provides  a  simple  representation  of  the  closed-loop  svstem  that  is  useful 

for  design,  and  simulations  validate  the  theoretical  results.  The  analysis  is  then  extended  to  the  non-ideal  case  where 

admeasurement  n°w  7  addltl0nal  dlStUrbances  are  present-  Again,  the  results  prove  useful  for  design  and  are 
lied  in  simulations.  Work  is  m  progress  to  extend  the  scheme  to  periodic,  non-sinusoidal  disturbances. 

2.  Rejection  of  periodic  disturbances 


2.1  Previous  work 

In  previous  work  [7]-[10]  an  adaptive  feedforward  control  (AFC)  algorithm  is  studied  for  the  purpose  of  cancelling 

disturbances  with  known  frequency.  The  basic  structure  of  the  algorithm  is  shown  in  Fig.  1.  The  disturbance  is  assumed 
to  be  of  the  form 


/ 


d(t)  =  e\  cos(a(i))  +  0*  sin(o(<)).  (1) 

Two  adaptive  parameters,  0X  and  62,  represent  the  estimates  of  the  two  components  of  the  disturbance  d,  which  is  to  be 
cancelled  by  the  input  u.  P{s)  is  the  transfer  function  of  the  plant  and  a(t)  =  f =  uxt,  where  is  the  angular 
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Figure  1:  Adaptive  feedforward  cancellation  scheme 

frequency  of  the  disturbance.  For  the  design  of  the  compensator  C(s),  algorithms  are  available  from  standard  adaptive 
control  theory.  A  Lyapunov-type  algorithm  yields  the  following  update  laws  for  the  adaptive  parameters 

=  —gy  cos(o),  82  —  —gysin(a),  (2) 

which  is  equivalent  to  letting  the  transfer  function  matrix  of  the  compensator  in  Fig.  1  be  C{s)  =  -g  diag  (1/s),  where 
9  >  0  is  the  adaptation  gam.  In  [7],  the  equivalence  between  the  adaptive  feedforward  control  algorithm  with  update 
(2)  and  a  linear  time-invariant  operator  is  established.  The  result  can  be  used  to  explain  a  phenomenon  observed  in 
experiments  where  high-order  harmonics  are  reduced,  although  the  algorithm  is  not  designed  for  this  task.  This  analysis 
provides  considerable  insight  on  how  to  adjust  the  adaptive  gains  for  stability  and  performance.  The  result  has  been 
used  to  design  feedforward  control  algorithms  exploiting  the  freedom  in  the  design  of  the  matrix  C(s).  In  [S],  experiments 
applying  the  algorithm  to  control  the  position  of  a  read/write  head  of  a  high-density  1  Gbyte  disk  drive  are  provided.  The 
experimental  results  confirm  the  validity  of  the  theoretical  analysis  and  its  usefulness  for  design.  In  fact,  the  maximum 
adaptation  gain  for  stability  can  be  predicted  precisely,  based  on  measurements  of  the  open-loop  frequency  response. 
The  closed-loop  disturbance  rejection  properties  of  the  algorithm  have  also  been  found  experimentally  to  closely  match 
those  predicted  by  the  theory.  In  [9]  and  [10],  further  refinements  to  the  method  are  described  so  that  loop  dynamics 
can  be  shaped  for  optimal  performance.  Experimental  results  again  support  the  conclusions  of  the  analvsis. 

Averaging  methods  can  be  applied  to  approximate  the  responses  of  the  adaptive  systems.  Defining  the  parameter 
errors  =  ffi  —  6\  and  y>2  =  —  9?,  the  averaged  system  is  found  to  be 


where 


C  = 


d_ 

dt 


Pr  P, 
-Pi  Pr 


<Pl,av 

=  -g  G 

<Pl,av 

<P2,  av 

;  Pr  -  £e[P(M)];  P,  =  /m[P(;Wl)]. 


If  the  update  laws  (2)  are  replaced  by 


the  averaged  svstem  becomes 


d_ 

Jt 


0^ 


-g 


y  cos(or) 
ysin(a) 


(3) 


(4) 


(5) 


d_ 

dt 


^Pl,av 

=  ~9  f  Vl’0” 

^p2,av 

L  ^2.™ 

(6) 
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Figure  2:  Phase-locked  loop 


This  system  is  a  set  of  simple  first-order  systems,  whose  dynamics  arP  h„  *•  .  •  „ 

be  easily  extended  to  the  case  where  multiple  sinusoid^  are  Dresent  hv  rin  '  aP  °am  9  >  The  scheme  can 

the  coefficients  in  a  similar  manner  as  before  P  b-  ^  l°  the  C°n‘ro1  in-DU‘  and 


2.2  Periodic  disturbances  with  unknown  frequency 


dirty  environments.  *  ’  6  SubJected  to  st™S  vibrations,  high  temperatures,  or 

<-»**«.  »yn it „ 

required  operation  (see,  e  g  fill  fl2]  [131)  However  notrh  fiit  *  j  gnai,  adaptive  notch  filters  can  perform  the 
problems.  Some  acL  nokel^  f  *  ^ering  problems  not  control 

used  for  noise  attenuation  or  an  accelerometer  Dlaced  on  the  mtaf  roPhone  placed  ahead  of  the  speakers  that  are 

•base  are  contro,  prob.ems,  the  „W.“  7”“*  "  W“' 

simpler.  We  discuss  here  algorithms  that  are  applicable  in  cases  thaTdo  not \S  pr°bIem  coasid^ly 

“tlr5  *77- fo'  7-e  - be  ~  “!Ump,,“- A“ivp  “pk- 

— — - — -  i:z^ 


3.  Adaptive  algorithm 

s;«r:  sstssstmT  ;  szzz?  tszsxs*  fr b  .  m.  *. 

of  the  system.  The  signal  r(t)  is  multiplied  by  a  signal  y(t)  thit  is  recons^trf' bvTT  “iT'T,  “  tl“  TT 

result  »  filtered  by  the  transfer  function  C(s).  This  leaner  function  “  W^Xte  ciclde  o^ttlj^',  T 

proportional  integral  (PI)  control  law.  The  signal  y  is  obtained  bv  apnlvinff  the'  ontn.T  ,  r  *  ?  ^  a°d  3 

called  a  voltage-controlled  oscillator.  In  mathematical  terms  this  is  the  cascade  of  an  t  T  ^  \  ^  “  COmmonly 

Ideally,  the  signals  r(<)  and  y(t)  are  90“  out  of  phase;  tin's  their  »7e71 Sf  “*  *  “ 

Since  the  output  signal  is  the  derivative  of  the  phase  of  the  input  simaf  it  is  aim  >h  ■  S,  ,  '  a"‘  °utImt  S‘S“L 
signal.  P  *£na  5  is  also  the  instantaneous  frequency  of  that 

At  this  point,  it  would  be  straightforward  to  applv  the  nhase-lorl-^  u™  f  , 

instantaneous  frequency  of  a  sinusoidal  signal.  However'  a  more  interesting  aonli  t fl°  °  eStlmatin-  the 

scheme  for  disturbance  rejection.  The  challenges  of  such  an  inteer.Uon  Le‘h.1  £“h iTd?  “  "  7 

itas*"  r7i“d  - th” — — -  <£ 
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Figure  3:  Adaptive  algorithm  for  sinusoidal  disturbance  cancellation 


Our  scheme  solves  these  problems  and  is  shown  in  Fig.  3.  In  the  figure,  9X  is  the  estimate  of  the  magnitude  of  the 
disturbance  signal,  and  82  is  the  estimate  of  its  instantaneous  frequency.  Further,  a  is  the  estimate  of  the  phase  of  the 
disturbance  signal;  it  is  the  integral  of  the  estimate  of  the  frequency  92.  The  transfer  function  matrix  C(s)  plays  a  similar 
role  as  in  Fig.  I,  but  its  design  is  different,  and  more  complex.  An  approximate  analysis  of  this  system  provide  criteria 
for  the  design  of  C(s). 

4.  Approximate  analysis  and  compensator  design 

The  analysis  technique  is  similar  to  one  used  for  analyzing  phase-locked  loops  in  FM  communication  systems  [15].  We 
assume  that  the  input  and  output  of  the  plant  are  signals  whose  spectrum  is  concentrated  around  the  frequency  u>i .  In 
particular,  this  implies  that  the  instantaneous  frequency  a  =  is  close  to  The  analysis  is  based  on  the  following 
assumptions: 

♦  the  disturbance  has  a  single  sinusoidal  component  d(t)  ~  dx  cos^f  4-  <5i),  where  dXl  ui,  and  6X  are  unknown; 

♦  8\  and  82  vary  sufficiently  slowly  that  the  response  of  the  plant  to  the  signal  u  can  be  considered  to  be  the  same 
as  that  of  a  sinusoidal  input  with  frequency  or  =  S2; 

♦  the  instantaneous  frequency  a  is  close  to  cj1?  so  that  P{ja)  can  be  replaced  by 

♦  the  phase  error  (a—  w\t  —  <5i)  is  small. 

With  these  assumptions,  the  output  of  the  plant  is  approximately  given  by 


y  =  ~PRdx  cos(o;ii  +  6X)  4-  Prdx  sin(ui*  4-  6X)  4*  Pr8\  cos(a)  -  P[$X  sin(a).  (7 

Two  signals  used  by  the  algorithm  are 

[  yi  1  _  [  y  cos(a)  1 

L  3/2  J  [  -ysin(a)  J  ‘  ^ 

Keeping  only  the  low  frequency  part  of  these  signals,  the  two  components  of  y  are  approximately  given  by  (using  (7)) 

Vx  =  "PRdi  cos  (wjf  +  Si  -  or)  +  ^P/di  sin  fat  +  <5i  -  a)  +  ^Pr8\, 


V2  =  Ipj?disin(wit +  61  -a)-^PidiCos(uit  +  5x-ot)-r^P[8i. 
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Simulations  in  the  next  section  show  that  the  approximation  is  indeed  excellent  in  the  cases  under  consideration 
without  introducing  an  additional  lowpass  filter. 

With  a  small  phase  error  oc  —  -  Si,  (9)  gives  the  linearized  relationship 

y\  1  _  r  [  9l  ~dl  1  rim 

.  y2J~°  diia-uit-k)  J’  U°J 

where  G  is  the  same  matrix  as  defined  in  (4).  Two  variables  Xi,  x2  are  defined  through 


1  =  Q-i  [  yi 
Xn  j  [  ’ 

fn  terms  of  the  parameter  errors  =  6\  —  d\  and  <p2  =  02  —  ^i,  they  satisfy 


(11) 


)da-Sl) 

As  a  result,  the  dynamics  of  the  system  from  the  parameter  errors  and  <p2  to  the  variables  x\  and  xn  are  those  of  a 
unity  gain  and  of  an  integrator  with  gain  d\t  respectively.  The  compensator  C(s)  can  then  be  chosen  to  be  the  cascade 
of  the  transformation  (11)  and  the  standard  adaptive  laws  of  the  form 


=  <Pi  =  Ci(s)[xi]}  62  =  (p2  =  C2(s)[x2],  (13) 

where  Ci(s)  and  C2(s)  are  selected  to  guarantee  the  closed-loop  stability  of  the  two  systems.  In  the  case  of  CT(s),  the 
dynamics  are  those  of  a  single  integrator.  In  the  case  of  6*2(5).  they  are  those  of  a  double  integrator.  Therefore,  one  can 
choose 


Ci(s)  =  ~9u  C2(s)  =  -£2^77,  (14) 

where  g\ ,  g2}  a ,  and  b  are  parameters  to  be  selected  in  order  to  yield  a  desirable  closed-loop  response.  In  summary,  the 
adaptive  algorithm  is  given  by  (8),  (11),  (13),  (14),  and 


u  =  9\  cos(a),  a  — 9 2.  (15) 

Because  the  magnitude  of  the  disturbance  di  acts  as  a  gain  in  the  second  transfer  function,  the  parameters  of  the 
compensator  C2{s)  must  be  designed  for  a  range  of  magnitudes  of  the  disturbance  Alternatively,  simple  techniques 
can  be  used  to  estimate  the  disturbance  level  before  the  algorithm  is  turned  on. 

The  algorithm  requires  the  knowledge  of  the  matrix  G  whose  elements  depends  on  the  unknown  frequency  wi.  We  can 
approximate  the  implementation  of  this  system  in  two  ways.  In  the  first  method,  we  design  a  compensator  that  works 
satisfactorily  for  a  range  of  matrices  G,  corresponding  to  a  range  of  frequencies.  Fortunately,  the  uncertainty  in  both  the 
frequency  estimate  S2  and  the  plant  characteristics  P(ju  1)  are  often  small  enough  such  that  a  compensator  designed  for 
a  frequency  in  the  mid-range  of  the  band  of  interest  is  satisfactory.  Another  option  is  to  use  the  matrix  corresponding 
to  the  estimated  frequency  a  —  62  for  G~ 1 .  The  dynamics  of  the  system  are  far  more  difficult  to  analyze  in  that  case, 
but  we  have  found  this  form  of  the  algorithm  to  work  well  in  simulations.  Finally,  note  that  whichever  implementation 
method  is  chosen,  some  knowledge  of  the  frequency  response  of  the  plant  in  the  frequency  range  of  interest  is  required. 

Simulation  results  —  Noiseless  case 

We  let  P(s)  —  100/(s  +■  100),  —  100,  and  d\  =  1.  The  parameter  g\  is  set  to  10,  leading  to  a  closed-loop  pole  for  the 

first  system  at  -10  rad/s.  The  other  parameters  are  set  to  g2  =  400,  a  =  5,  and  6  =  30,  which  lead  to  three  closed-loop 
poles  for  the  second  system  located  at  —10  rad/s  and  —10  ±  7 10  rad/s. 

Fig.  4  shows  the  output  of  the  plant,  in  raw  value  on  the  left  and  in  log  scale  on  the  right.  The  output  is  found  to 
decrease  to  negligible  values  in  less  than  a  second.  The  adaptive  parameters  are  shown  on  Fig.  5  and  converge  rapidly. 
On  the  left  and  on  the  right  are  the  responses  for  0\  (magnitude)  and  for  02  (frequency)  respectively.  The  smooth  curves 
are  the  responses  of  the  approximate  system,  while  the  oscillatory  ones  are  for  the  original  parameters.  The  match 
between  the  original  and  the  approximate  system  responses  is  excellent  for  the  frequency,  and  less  so  for  the  magnitude, 
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Figure  4:  Plant  output  (left)  and  log  of 


probably  because  of  nonlinear  effects  that  were  neglected  in  the  linearised  analysis.  Note,  for  example,  that  both  0,  ~  , 
and  Si  =  -1  are  potential  equilibrium  points  of  the  algorithm.  1  ~  1 

■  !”  th'  Sil"“‘*“°n'  the  Sy“m  *bl'  ‘°  converge  despite  «  10%  initial  error  in  freqnencv.  It  was  found  that  th, 
scheme  was  able  to  aoqn.rn  frequence  with  erro«  up  to  30%.  It  is  well-known  that  an  important  character  s 
phase-locked  loops  is  their  incfcm  (or  fa ll-in)  ranSe  (16).  Careful  design  of  the  loop  transfer  function  can  increase  th! 

if  a  praS  Addilional  «•»  ^  used  for  ^qnisi.ion,  and  would  be  pM 


5.  Noise  analysis 

The^  previous  derivation  considered  the  noiseless  case,  which  resulted  in  nominal  values  for  the  parameters  of  07  =  d 

°2~Ul;  f,nd  n°mmal  funflons,  “*(*)  =  and  lT(t)  =  0.  In  this  section,  the  perturbations  due  to  a  small  noise  /n 
added  at  the  outpu  is  evaluated.  We  define  *  =  ,  92  =  9'2  +  692,  y  =  f  +  Sy,  and  y  =  V+8y  +  where  i  t 

the  actual  output  of  the  plant  and  y  is  the  measured  output  (the  one  used  by  the  algorithm).  Since  y'  =  0  we  see  that 
y  -  Sy  and  y  =  Sy,  where  6y  =  6y+  6n.  We  define  the  components  of  the  measured  output  as  hat 

(16) 

Again,  these  two  variables  are  the  ones  that  are  used  by  the  algorithm,  instead  of  yx  and  which  are  defined  for  th* 
purpose  of  analysis  only.  For  the  noise,  we  introduce  the  representation  he 


yi 

y  cos(a) 

.  y? . 

-ysin(a) 

where  dnf(t)  and  6nq(t) 
components  Sni  and  Sn2 


6n(t)  —  6rii(t)  cos (a"(t))  —  dn?(t)sin(a:'(l)), 

are  assumed  to  vary  much  slower  than  cos(a‘(f)).  With  the  low 
are  defined  as 


-pass  approximation,  the 


(i7) 

noise 


Sni 

Sn  cos(a*) 

Sn2 

— <5nsin(c**) 

.  f^n5  . 

(18) 


alf  tW0  fTf-r  muCti0DS  of  interest  in  the  Presence  Of  noise:  the  transfer  function  from  Sn  to  „  and 
^  “  UQ'tl0n  fr°m  Sn  °  yLThe  first  transfer  Action  indicates  how  much  the  actual  output  is  affected  by  the 

noise.  One  would  want  to  make  this  transfer  function  small  if  Sn  represented  measurement  noise  However  the  L™ 
formalism  can  also  be  used  if  5n  represents  the  effect  of  additional  disturbances  that  affect  the  output  of  the  plant  b 

bt  smS Therlmlt  b  *°  ^  *ransffr  function’  from  5n  *>  V,  small,  so  that  the  measured  output  would 

be  small.  There  may  be  cases  where  there  are  disturbances  that  one  may  not  wish  to  cancel  One  such  case  is  in  *  nrW 

control  system  m  which  the  noise  contains  a  large  periodic  component  and  a  white  noise  component  The  white  noise 
may  be  considered  acceptable  physiologically,  and  would  best  be  treated  as  measurement  noise 
We  now  begin  the  analysis,  noting  that 


yi  -  cos(o-  +  Sa)(ym  +8y  +  Sn),  y2  -  -sin(a-  +  6a)(y'  +  Sy  +  Sn), 
so  that,  with  y*  =  0  and  neglecting  second-order  effects,  it  follows  that 


(19) 


Syi  =  5ycos(a')  +  Snu  Sy2  =  -<Sysin(o*)  +  Sn-,.  (20) 

"*  p“‘  °f  "*  al6“ithm  lh,t  “  "d  ~  a-*-  in  — 


Sxi 

-  G~~l 

<5yi 

Sx  2 

—  u 

Sy2 

sex 


The  control  input  and  its  variation  are  given  by 


Ci(s) 


Sxi, 


u-(e\+  SOi)  cos(q-  +  So),  5u  =  cos (a‘)66i  -  91  sin (a')Sct. 

Assuming  slow  variations  of  S9l  and  dor,  the  output  of  the  plant  corresponding  to  this  input  is  given  by 

Sy  =  PRcos(am)59l  -  PRdl sin(a*)do  -  P,  sin^')^  -  Pt9\  cos (a‘)Sa. 


(21) 


(22) 

(23) 
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Multiplication  of  this  signal  by  cos(a*)  and  sin(a‘)  yield  signals  whose  low-frequency  components  are  given  by  (again 
neglecting  second-order  terms): 


Sy\  =  ^-PrM i  ~  Sy2  =  ^ Pr9[Sq  +  | Pi68x  +  6n2. 

As  a  result,  we  have  that 


For  the  parameter  variations,  we  have 


50!  ‘ 

60  2 


CM 

s 

0 


66, 


s 


+  G-1 


6n\ 

8  772 


(24) 


(25) 


(26) 


which  leads  to  the  following  transfer  function  between  the  components  of  the  noise  and  the  parameter  variations 


Ci(s) 

0 

sC2(s) 

1 - t 

o,  o, 

to  »-* 

s-Ci(s) 

0 

<*-■  [ £ ; 

s2-9lC2(s)  _ 

The  relationship  between  the  noise  variations  and  the  measured  plant  output  variations  is 


Cl  (5) 

0 

s0lC?(s) 

Sy  i 
Sy2 

= 

G 

s  -  C,(s) 

n 

V 

s2  -  eic2(s) 

while  the  relationship  to  the  actual  plant  output  variations  is 


\ 

G~l  + 1 

J 


8n  i 
8n2 


Syi 

—  Cr 

s  -  Ci(s) 

0 

/"■>—  1 

[  Sn,  ' 

8y2 

—  Or 

0 

s&,  G2(s) 

Cj 

[  8tl2 

s2  -  e\c2{s) 


(28) 


(29) 


The  formulas  can  be  useful  in  several  ways.  For  example,  if  the  noise  Sn  has  a  flat  power  spectral  density  Sn(f)  over 
a  bandwidth  /#  centered  around  fx  =  uj1/2tc,  it  is  common  to  assume  that  5n,(/)  and  Sn«(/)  also  have  flat  spectral 
density  over  a  bandwidth  fe  with  the  same  power  level  but  centered  around  /  =  0  [15].  One  can  then  derive  the  densities 
Snx(f)  and  Sn2(f)  as  well  as  5Vl(/)  and  Sy2(/)  using  (29).  The  expected  values  of  yj  and  y?  can  be  calculated  by 
integrating  the  power  spectra.  Finally,  one  concludes  that  the  output  y  is  a  sinusoid  with  a  randomly  and  slowly- varying 
peak,  whose  expected  value  is 


E[yf  +  y2q]  =  4  £[yf]  +  4  E[y\}.  (30) 

A  similar  calculation  applies  if  the  noise  is  deterministic,  as  will  be  shown  in  the  next  section. 

Simulation  results  -Noisy  case 

The  second  set  of  simulations  verifies  the  results  of  the  analysis  for  the  non-ideal  case.  Although  the  results  can  be 
used  to  assess  the  impact  of  measurement  noise  on  the  system,  we  elect  to  apply  the  results  to  study  the  effect  of  plant 
disturbances.  We  consider  the  case  of  deterministic  disturbances,  so  that  the  results  of  the  analysis  can  be  precisely 
verified  without  extensive  Monte-Carlo  simulations.  We  also  consider  two  special  cases  of  additive  output  disturbances 
that  correspond  to  an  equivalent  input  disturbance  that  is  a  sinusoid  with  a  varying  magnitude,  or  with  a  varying 
instantaneous  frequency.  Interestingly,  these  two  problems  can  be  cast  in  the  framework  of  additive  output  disturbances, 
and  the  results  help  to  explain  the  tracking  ability  of  the  algorithm. 

*  First,  we  assume  that  the  disturbance  d{t)  is  replaced  by  d{t)  =  (14-  0.1  cos(t))  cos(100f),  i.e.,  a  sinusoidal  function 
that  is  amplitude  modulated  by  a  sinusoidal  function  of  much  lower  frequency,  with  a  modulation  index  of  10%.  We  take 
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the  same  plant  as  in  the  first  simulation,  and  make  the  approximation  that  the  output  of  the  plant  corresponding  to  d{t) 
is  the  output  to  cos(100i),  itself  modulated  by  1  -f-  0.1  cos(t).  Then,  the  additional  disturbance  can  be  represented  by  an 
equivalent  output  disturbance  with  the  following  components:  <5ni(t)  =  —0.025  cos(t),  Sn2(i)  =  0.025  cos(£)-  It  turns  out 
that 


Sni 

'  -0.1  ' 

Sn2 

0 

cos(f), 


(31) 


which,  because  of  the  diagonal  form  of  the  transfer  function  in  (27),  implies  that  only  the  parameter  &i  will  be  affected. 
This  result  is  expected  since  only  the  magnitude  of  the  disturbance  changes  with  time.  The  analysis  (equation  (27)) 
predicts  that  the  parameter  variation  SO  i  is  given  by  SO  *  =  0.099  cos(t)  4-  0.0099  sin(t).  Equation  (28)  gives 


Syx  1  _  f  —0.0002  cos(t) -f- 0.0025  sin(t) 

Sy2  J  0.0002  cos(t)  —  0.0025  sin(t)  J  * 

Assuming  that  Sy  —  A(t)  cos(100<)  —  B(t)  sin(100<)  where  A(t)  and  B(t)  are  slowly-varying  functions  of  time,  one  has 
that  Syi  =  A(t)/ 2  and  Sy2  =  B{i)  j 2,  so  that 


y/m*  +  W) I2  =  2^yi  +m-  (33) 

This  formula  leads  to  a  predicted  peak  magnitude  of  Sy  equal  to  0.0070.  Note  that,  in  the  case  where  Sn  models  a  plant 
disturbance,  Sy  is  the  actual  plant  output,  as  Sy  does  not  have  a  physical  reality. 

Fig.  6  shows  Sy,  the  plant  output.  As  expected,  the  signal  appears  as  a  sinusoidal  function  of  high  frequency, 
modulated  by  a  lower  frequency  signal.  The  magnitude  corresponds  to  the  prediction  of  the  analysis  (0.0070).  Fig. 
7  shows  the  adaptive  parameters.  As  expected,  only  the  parameter  0\  which  corresponds  to  the  magnitude  of  the 
disturbance  is  affected.  The  variation  follows  closely  the  shape  of  the  disturbance  (0.1cos(t)),  as  predicted  by  the 
analysis.  The  parameter  02,  which  estimates  the  frequency  of  the  disturbance,  remains  constant. 

When  the  rate  of  variation  of  the  magnitude  of  the  disturbance  is  ten  times  faster,  i.e.,  the  frequency  of  the  mod¬ 
ulating  sinusoid  is  10  rad/s,  the  numerical  analysis  predicts  that  the  adaptive  parameter  satisfies  60i  =  O.Oocos(lOt)  + 
0.05  sin(10t).  Because  of  the  much  higher  frequency,  the  response  is  delayed  and  smaller  than  required  for  the  cancellation 
of  the  disturbance.  Simulation  results  validate  the  analysis  for  the  parameter  variations,  but  are  omitted  for  brevity.  In 
this  case,  the  peak  magnitude  of  the  output  of  the  plant  was  calculated  and  verified  in  simulations  to  be  0.05,  which  is 
seven  times  higher  than  previously.  Note  that  10  rad/s  is  a  fairly  high  frequency  for  this  system,  since  10  rad/s  is  the 
approximate  bandwidth  of  the  closed-loop  system. 
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Figure  9:  Adaptive  parameters  -  Frequency  modulation  of  low  frequency 

Next,  we  consider  a  similar  example  but  with  frequency  modulation  of  the  disturbance,  so  that  d(t)  =  cos(100t-sin(t)). 
The  instantaneous  frequency  of  this  signal  is  100  +  cos(t).  By  taking  the  narrowband  approximation  of  this  signal. 
d(t)  =  cos(100Z)  -  sin(<)  sin(100<).  Assuming  that  the  output  is  equal  to  the  output  for  the  sinusoids  at  100  rad/s 
multiplied  by  the  same  slowly- varying  coefficients  as  the  input  signal,  the  equivalent  output  disturbance  is  calculated  as 
<5ni(t)  =  — 0.25sin(<)  and  Sn2(t)  =  — 0.25sin(i),  with 


1 

<5ni 

0 

.  _ 

_  -1  _ 

sin(t). 


(34) 


The  numerical  analysis  now  predicts  that  <50i  =.  0,  which  is  consistent  with  the  fact  that  only  the  instantaneous  frequency 
of  the  disturbance  signal  varies.  Furthermore,  Sd2  =  1.015  cos(f)  4-  0.02  sm(t).  This  function  is  close  to  the  deviation  in 
the  instantaneous  frequency  of  the  disturbance  signal,  which  is  equal  to  cos(t).  The  predicted  peak  output  magnitude  is 
calculated  to  be  0.011  - 

Fig.  8  shows  Sy,  which  is  the  output  of  the  plant.  The  signal  appears  as  a  sinusoidal  function  of  high  frequency, 
modulated  by  a  lower  frequency  signal  whose  magnitude  corresponds  to  the  prediction  of  the  analysis  (0.011).  Fig.  *9 
shows  the  adaptive  parameters.  As  expected,  only  the  parameter  62  which  corresponds  to  the  frequency  of  the  disturbance 
is  affected.  The  variation  follows  that  of  the  deviation  in  frequency  of  the  disturbance  (cos(f)).  The  parameter  Bv  which 
corresponds  to  the  magnitude  of  the  disturbance  remains  constant. 

The  case  where  the  instantaneous  frequency  of  the  disturbance  was  100  +  cos(10t)  was  also  considered.  Simulation 
results  are  omitted  for  brevity.  The  analytical  result  was  682  =  cos(10f)  +  sin(10t).  In  this  case,  the  magnitude  of  the 
variation  of  the  parameter  is  larger  than  the  deviation  of  the  actual  parameter,  and  it  leads  the  actual  deviation  (in  the 
amplitude  modulation  case,  the  deviation  was  smaller  and  was  lagging).  The  peak  output  was  calculated  and  verified  in 
simulations  to  be  0.0707,  which  is  7  times  higher  than  the  equivalent  case  for  the  low  frequency.  As  expected,  there  is  a 
degradation  of  performance  when  the  rate  of  variation  of  the  magnitude  or  frequency  of  the  disturbance  signal  is  close 
to  the  bandwidth  of  the  system. 

Finally,  note  that,  in  the  simulations,  G  was  assumed  to  be  set  to  the  nominal  value  corresponding  to  100  rad/s. 
Simulations  with  the  nominal  G  replaced  by  one  that  was  continuously  adjusted  using  the  estimated  frequency  did  not 
exhibit  significant  differences  in  the  responses. 


6.  Conclusions 

In  this  paper,  we  discussed  a  method  for  the  rejection  of  sinusoidal  disturbances  with  unknown  frequency.  While 
disturbance  rejection  for  signals  with  known  frequency  has  been  addressed  extensively  in  the  literature  using  various 
approaches,  the  analogous  task  for  signals  with  unknown  frequency  has  received  little  attention.  Such  problems  are 
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expected  to  gain  importance,  however,  in  view  of  the  extensive  applications  where  such  methods  are  needed,  such  as  in 
active  noise  and  vibration  control. 

The  adaptive  algorithm  incorporated  a  phase- locked  loop  concept  within  a  disturbance  cancellation  control  law.  The 
scheme  exhibited  good  convergence  properties,  and  allowed  for  tracking  of  signals  with  slowly  varying  characteristics. 
The  analysis  allowed  to  predict  precisely  the  loss  of  performance  in  the  presence  of  noise  and  additional  disturbances 
(in  terms  of  residual  output  error),  and  the  response  of  the  parameters.  An  area  of  current  research  is  the  extension  of 
the  algorithm  and  of  its  analysis  to  the  case  where  multiple  frequency  components  are  present,  especially  when  they  are 
harmonically  related. 
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Abstract — Two  algorithms  are  presented  for  the  rejection  of 
sinusoidal  disturbances  with  unknown  frequency.  The  first  is  an 
indirect  algorithm  where  the  frequency  of  the  disturbance  is 
estimated,  and  the  estimate  is  used  in  another  adaptive  algo¬ 
rithm  that  adjusts  the  magnitude  and  phase  of  the  input  needed 
to  cancel  the  effect  of  the  disturbance.  A  direct  algorithm  that 
uses  the  concept  of  a  phase-locked  loop  is  also  presented  in 
which  frequency  estimation  and  disturbance  cancellation  arc 
performed  simultaneously.  Approximate  analyses  are  presented 
for  both  schemes  and  the  results  are  found  useful  for  the  selec¬ 
tion  of  the  design  parameters.  Simulations  are  given  which 
demonstrate  the  validity  of  the  analytical  results  and  the  ability 
of  the  algorithms  to  reject  sinusoidal  disturbances  with  un¬ 
known  frequency.  The  indirect  algorithm  is  found  to  have  a  lar¬ 
ger  capture  region  for  the  parameter  estimates,  whereas  the 
direct  algorithm  has  superior  convergence  properties  locally 
about  the  optimum  parameter  estimates  f;,  1997  Elsevier 
Science  Ltd.  All  rights  reserved. 

1.  INTRODUCTION 

In  this  paper,  we  consider  the  problem  of  attenuat¬ 
ing  an  output  signal  y(f)  that,  in  the  Laplace  do¬ 
main,  is  given  by 

y{s)  =  P(sMs)  -  d{s)),  (1) 

where  u(s)  and  d{s)  are  the  Laplace  transforms  of  the 
controller  output  and  disturbance  signals,  respec¬ 
tively,  and  P(s)  is  the  Laplace  transform  of  the 
impulse  response  of  the  plant.  The  plant  is  assumed 
to  be  linear,  time-invariant,  and  stable.  The  goal  of 
the  control  system  is  to  generate  u(t)  such  that 
y(t)  -*  0  as  t  -+  co .  We  assume  that  the  disturbance 
d(t)  is  a  sinusoid  of  fixed  magnitude  ()*  and  fixed 
frequency  an  such  that 

d(t)  =  0*cos(a4r)),  dU  (t)  =  a>\.  (2) 
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In  this  task,  the  parameters  fl? ,  cot,  and  ad(0)  are  all 
unknown. 

Algorithms  for  solving  the  above  problem  have 
use  in  a  wide  range  of  applications.  Of  particular 
interest  is  the  problem  of  active  noise  and  vibration 
control,  in  which  d(i)  is  an  offending  noise  or  vibra¬ 
tion  source  and  P(s)  is  the  transfer  function  of  the 
output-actuator-to-error-sensor  propagation  path. 
Often,  the  noise  source  consists  mainly  of  periodic 
components  due  to  rotating  machinery  generating 
the  undesired  noise  signal.  Examples  of  such  noises 
include  engine  noise  in  turboprop  aircraft  (Emborg 
and  Ross,  1993),  engine  noise  in  automobiles 
(Shoureshi  and  Knurek,  1996),  and  ventilation 
noise  in  HVAC  systems  (Eriksson,  1988).  In  prac¬ 
tice,  the  frequency  of  the  disturbance  is  usually  not 
known  and  may  even  vary  during  operation.  In 
these  cases,  it  is  desirable  to  place  an  encoder  or 
tachometer  on  the  rotating  machine  that  is  at  the 
origin  of  the  disturbance  to  measure  the  frequency 
of  the  disturbance.  Alternatively,  if  a  sensor  can  be 
placed  near  the  source  of  the  disturbance  such  that 
d(t)  can  be  accurately  characterized,  then  the  con¬ 
trol  task  reduces  to  that  of  adaptive  feedforward 
control  (AFC)  (see  Nelson  and  Elliott,  1992).  How¬ 
ever,  it  is  impossible  to  use  such  a  sensor  in  applica¬ 
tions  where  the  addition  of  the  sensor  is  too  costly 
or  reduces  the  reliability  of  the  overall  system  due 
to  strong  vibrations,  high  temperatures,  or  dirty 
conditions  within  the  environment. 

In  this  paper,  we  present  two  adaptive  control 
algorithms  for  the  rejection  of  sinusoidal  distur¬ 
bances  with  unknown  frequency.  These  systems 
only  require  a  single  sensor  located  at  the  output  of 
the  plant  for  their  operation.  The  first  approach 
combines  an  AFC  scheme  for  attenuating  sinu¬ 
soidal  disturbances  with  known  frequency  as  de¬ 
scribed  and  analyzed  in  Bodson  et  ai  (1994)  and 
Sacks  et  ai  (1996),  together  with  an  algorithm  to 
estimate  the  frequency  of  the  disturbance.  This  ap¬ 
proach  is  called  indirect  because*  the  frequency  of 
the  disturbance  is  estimated  independently  of  the 
cancellation  scheme.  The  second  approach  consists 
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in  extending  the  AFC  scheme  of  Bodson  et  al 
(1994)  and  Sacks  et  al  (1996)  by  integrating 
a  phase-locked  loop  within  the  scheme  so  that  dis¬ 
turbances  with  unknown  frequency  can  be  directly 
cancelled.  Our  analyses  of  these  two  methods  en¬ 
able  the  design  of  the  systems  to  provide  useful 
rejection  of  sinusoidal  disturbances,  and  simula¬ 
tions  validate  the  theoretical  results.  Our  results 
indicate  that  the  direct  algorithm  has  superior  con¬ 
vergence  properties  locally  about  the  optimum 
convergent  point  of  the  controller,  whereas  the 
indirect  algorithm  provides  a  wider  capture  region 
for  the  system’s  adaptive  parameters. 


2.  INDIRECT  APPROACH 


2. 1 .  Frequency  estimation 

Our  development  of  the  indirect  algorithm  relics 
on  a  method  for  the  estimation  of  the  frequency  of 
a  signal.  Here,  we  consider  an  adaptive  notch  filter 
developed  in  Regalia  (1991)  that  is  designed  to 
eliminate  one  (or  more)  periodic  component(s)  from 
a  measured  signal.  This  adaptive  notch  filter  esti¬ 
mates  the  frequency  of  the  unknown  signal  as  part 
of  its  operation.  In  our  work,  we  transpose  Re¬ 
galia’s  algorithm  to  continuous-time  so  that  stan¬ 
dard  averaging  methods  can  be  used  to  analyze  the 
system’s  equations.  It  is  relatively  straightforward 
to  transfer  the  results  of  our  control  system  design 
back  to  the  discrete-time  domain  for  implementa¬ 
tion  purposes. 

Consider  the  problem  of  estimating  the  fre¬ 
quency  co  of  a  signal  y(f),  where  9/  is  the  resulting 
estimate.  The  continuous-time  version  of  Regalia’s 
algorithm  has  three  states  0/,x  i,  and  X2,  that  satisfy 
the  differential  equations 

X\  -  X2,  (3) 

X2  =  —  2£9  fxi  —  9}x  i  +  ky ,  (4) 

0/  =  -g\(ky-2£0fX2)xi.  (5) 

Note  that  this  system  of  equations  is  highly  non¬ 
linear.  The  three  parameters  of  the  system  are  the 
adaptation  gain  g i,  the  damping  factor  £,  and  a 
filter -gain  k,  all  of  which  are  positive-valued.  The 
algorithm’s  behavior  can  be  explained  through  an 
averaging  analysis,  justified  for  small  values  of 
g i  and  for  a  periodic  signal  y(t)  (cf.  Sastry  and 
Bodson.  1989).  For  9/  constant, 


.Vi  = 


£M/) 


Lyl 


X  2  = 


ks 


D(s.Of) 


[J*  (6) 


where  D{s,0/)  =  s2  4-  2 £0/s  +  0}.  Furthermore,  t 

<7> 


By  application  of  averaging  theory,  the  evolution  of 
the  state  9f  can  be  approximated  by  the  solution  of 
the  averaged  system,  which  is  given  by 


-g,AVG\ 


~k(s2  +  02A 


D(s,  0„)  D(s,  d„A 


]  .i 


-lyl  ■  (8) 


Assuming  that  y(r)  =  in  (o>,f  +•  <£,),  the  aver¬ 

aged  system  is  given  by 


il  y  -  (of) 

2  ,.f,  (01  -  c of)2  +  (2 ' 


If  the  signal  y(t)  has  a  single  sinusoidal  component, 
the  analysis  indicates  that  the  averaged  system  has 
a  pair  of  equilibrium  points  at  fl3V  =  +  <wl#  Around 
to h  the  linearized  system  is  exponentially  stable, 
with  dynamics 

(hk:r2t 

(L=  (10) 


In  other  words,  the  algorithm  is  able  to  identify  the 
frequency  of  the  signal  rq.  Even  in  the  presence  of 
multiple  sinusoids,  the  algorithm  is  able  to  lock 
onto  a  main  frequency  component  despite  t lie  pres¬ 
ence  of  competing  tones.  Typically,  the  averaged 
system  will  exhibit  multiple  equilibrium  points.  If 
the  parameter  £  is  small,  the  first  term  in  the  sum  of 
(9)  will  dominate  the  others  when  is  close  to  cou 
Therefore,  in  the  neighborhood  of  0av  =  <ou  the 
right-hand  side  of  (9)  will  be  approximately  the 
same  as  that  of  the  system  with  only  one  sinusoidal 
component.  The  same  argument  can  be  repeated 
for  the  other  frequencies,  so  that  there  will  be  an 
equilibrium  point  associated  with  each  of  the 
sinusoidal  components  of  the  signal  y(t).  The  initial 
value  of  0f  and  the  magnitudes  of  the  frequency 
components  rt  affect  the  frequency  towards  which 
Of  will  converge. 


2.2.  Indirect  adaptive  algorithm 
The  algorithm  for  frequency  estimation  can  be 
combined  with  the  adaptive  feedforward  control 
scheme  in  Sacks  et  al.  (1996)  to  produce  an  algorithm 
capable  of  attenuating  periodic  disturbances  with 
unknown  frequency.  The  control  law  is  given  by 

u[()  =  0t{t) cos(a(/))  -  0s(t)sin{y:(t)), 


m  =  (11) 

where  the  two  adaptive  parameters  ()c  and  0S  are 
updated  as 


and 


'Of 

=  -02G“‘ 

ycos(a) 

Jh . 

_  —  y  sin(a)_ 

(12) 


P i  =  Im  [P(jw,)]. 


PR  =  Re[P(j(o,)]; 

(13) 
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The  parameter  g2  >  0  is  an  arbitrary  adaptation 
gain.  The  averaging  analysis  of  (12)  and  (13)  shows 
that,  for  small  values  of  the  gain  g2,  the  dynamics  of 
this  adaptive  system  are  approximately  the  same  as 
those  of  two  decoupled,  first-order  systems,  with 
their  poles  located  at  —  02(rad/s). 

Note  that  the  algorithm  in  (12)  and  (13)  uses  the 
value  of  the  frequency  response  of  the  plant  at  the 
frequency  of  the  disturbance  c ov  However,  the  stab¬ 
ility  of  (12)  for  small  gain  g2  is  guaranteed  so  long 
as  the  phase  of  the  frequency  response  is  correct  to 
within  ±  90°.  Therefore,  a  rough  estimate  of  col  in 
(12)  will  be  adequate  in  most  cases.  If  desired, 
(o  i  may  also  be  replaced  by  fly  in  (13). 

2.3.  Simulations  of  the  indirect  algorithm 

We  now  present  simulations  of  the  indirect  algo¬ 
rithm  for  a  plant  given  by  P(s)  =  100  {s  4-  100) 
and  a  sinusoidal  disturbance  d(t)  —  cost  100/ ).  In  the 
frequency  estimation  algorithm,  we  choose  the  in¬ 
itial  states  to  be  equal  to  zero,  and  we  choose 
{  =  0. 1.  k  =  100.  and  gx  =  1000.  With  these  para¬ 
meter  choices,  the  pole  of  the  linearized  system  in 
(10)  is  at  —  125  rad  s.  In  the  AFC  scheme,  the 
initial  states  of  the  system  are  set  to  zero,  and  we 
choose  cji  =  10.  Such  a  parameter  choice  yields  an 
averaged  system  with  two  real  poles  at  —  10  rad/s. 
as  predicted  by  the  analysis  in  Sacks  et  ai.  (1996). 

For  our  first  simulation,  frequency  estimation 
and  disturbance  cancellation  are  performed  separ¬ 
ately.  Specifically,  for  the  first  second  of  the  simula¬ 
tion,  the  parameters  of  the  AFC  scheme  are  frozen 
while  an  accurate  estimate  of  the  frequency  of  the 


disturbance  is  calculated.  Then,  the  frequency  esti¬ 
mate  is  fixed  for  t  >  1  and  is  used  by  the  AFC 
scheme  to  adjust  the  amplitudes  of  the  cos(  )  and 
sin(  * )  components  of  the  controller  to  attenuate  the 
disturbance. 

Figure  1  shows  the  frequency  estimate  produced 
by  the  algorithm,  as  indicated  by  the  solid  line  in 
the  figure.  For  our  parameter  choices,  the  fre¬ 
quency  estimation  algorithm  in  (12)  and  (13)  con¬ 
verges  within  the  first  second  of  the  simulation  to 
the  value  6f  =  99.95  rad/s,  a  value  close  to 
a>i  =  100  rad/s.  The  response  predicted  by  the  non¬ 
linear  averaged  system  in  (8)  is  shown  as  a  dashed 
line  on  this  figure  and  is  seen  to  closely  approxim¬ 
ate  the  true  system’s  transient  response.  Note  that 
the  frequency  estimation  algorithm  converges  to  its 
proper  setting  despite  a  100%  initial  error  in  the 
frequency  estimate,  and  the  ability  of  this  algorithm 
to  lock  onto  the  frequency  of  the  unknown  distur¬ 
bance  is  useful  in  many  practical  situations. 

Figure  2  shows  the  logarithm  of  the  output  of  the 
plant,  computed  as  log(|y(/)|  4-  /;)  where  v.  =  10'°. 
The  envelope  of  the  plant  output  is  constant  during 
the  frequency  estimation  phase  of  the  controller's 
operation  and  is  seen  to  decrease  rapidly  once  the 
AFC  algorithm  is  engaged.  The  system’s  output 
does  not  decrease  significantly  after  a  period  of 
time.  The  evolutions  of  flc  and  fls  are  shown  in  Fig.  3 
as  a  solid  line  and  a  dashed  line,  respectively.  While 
the  parameters  appear  to  be  drifting  for  t  >  2  s, 
their  variation  is  in  fact  sinusoidal  at  a  frequency 
equal  to  the  difference  between  the  true  and  esti¬ 
mated  frequencies  of  disturbance,  and  the  sum  of 


Fig.  1.  Frequency  estimate  for  the  indirect  algorithm— separate  adaptation. 
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the  squares  of  the  parameters  remains  close  to  one 
over  this  time  period.  Note  that  continuous  vari¬ 
ations  of  the  amplitudes  of  the  cos(-)  and  sin(-) 
components  of  the  controller  output  are  necessary 
tOTeduce  the  disturbance  amplitude  when  the  fre¬ 
quency  estimate  9f  is  not  exact,  resulting  in  a  low 
residual  output  error  in  steady  state. 


We  now  explore  the  performance  of  the  indirect 
scheme  in  a  true  adaptive  mode  in  which  all  the 
parameters  are  adjusted  simultaneously.  Although 
this  implementation  might  be  expected  to  resolve 
the  convergence  problems  observed  with  separate 
parameter  adaptation  stages,  such  is  not  the  case. 
The  log  of  the  plant  output  is  shown  in  Fig.  4. 
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Kin.  4.  Log  of  the  plant  output  for  the  indirect  algorithm  simultaneous  adaptation. 


Although  this  implementation  yields  a  more  rapid 
decrease  of  the  plant  output,  a  substantial  residual 
error  remains  at  the  end  of  the  simulation  run.  In 
this  case,  the  lack  of  asymptotic  convergence  may 
be  attributed  to  the  fact  that  the  control  input 
eliminates  the  signal  which  is  used  for  the  frequency 
estimation,  thus  preventing  accurate  convergence 
of  0f.  This  problem  is  an  indication  of  the  fact  that 
the  indirect  scheme  is  overparameterized  and  can 
be  resolved  by  considering  a  direct  adaptive  scheme 
in  which  the  amplitude  and  phase  of  the  sinusoidal 
component  are  computed  via  a  single  combined 
procedure,  as  we  now  show. 


Fig.  5.  Direct  adaptive  algorithm  for  sinusoidal  disturbance 
cancellation. 


3.  A  DIRECT  ALGORITHM 
3.1.  Adaptive  algorithm 

An  alternative  approach  to  the  indirect  scheme 
of  the  previous  section  is  a  direct  scheme  in  which 
a  single  error  signal  is  used  to  update  the  frequency 
and  the  magnitude  estimates  simultaneously.  Here, 
one  such  algorithm  is  presented  that  combines  ele¬ 
ments  of  the  AFC  scheme  discussed  earlier  with 
a  modified  version  of  a  phase-locked  loop  stru¬ 
cture  commonly  used  in  communication  systems 
(Hambley,  1990). 

This  scheme  is  shown  in  Fig.  5.  In  the  figure,  0{  is 
the  estimate  of  the  magnitude  of  the  disturbance 
signal,  and  02  is  the  estimate  of  its  instantaneous 
•  frequency.  Moreover,  a  is  the  estimate  of  the  phase 
of  the  disturbance  signal  and  is  the  integral  of  the 
estimate  of  the  frequency  02.  The  equations  for  the 


control  algorithm  are 

u  =  Oi  cos(a),  a  =  02 ,  y i  =  ycos(a), 

(14) 

v2  =  -  ysin(a). 

The  user-defined  transfer  function  matrix  C(s)  re¬ 
lates  the  signals  jq  and  y2  to  the  parameters  9 1  and 
02 ,  respectively.  An  approximate  analysis  of  this 
adaptive  system  will  allow  us  to  deduce  a  simple 
procedure  for  the  design  of  C(s)  to  obtain  adequate 
performance  from  this  system. 

3.2.  Approximate  analysis 

Our  analysis  is  based  on  a  fundamental  fact, 
whose  proof  is  reminiscent  of  derivations  found  in  ^ 
the  analysis  of  frequency-m'odulation  communica¬ 
tion  systems  (cf.  Hambley,  1990). 
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Assumptions. 

•  The  values  of  di  and  d2  vary  sufficiently  slowly 
that  the  response  of  the  plant  to  the  signal  u(t)  can 
be  approximated  by  the  steady-state  output  of 
the  plant  for  a  sinusoidal  input  with  frequency  92. 

•  The  instantaneous  frequency  92  is  close  to  cou 
such  that  P(j02)  can  be  replaced  by  P(jcot). 

Basic  fact.  Considering  low-frequency  components 
only,  the  two  signals  y^t)  and  y2(t)  are  approxim¬ 
ately  given  by 

Lp2(0  J 

where  G  is  as  defined  in  (13). 

Proof.  Under  the  assumptions,  the  output  of  the 
plant  is  given  by 

y(t)  =  PR/Mf)cos(x(0)  -  P|^i(f)sin(a(f)) 

-  PK</,  coslxj  (/))  4*  Pjf/jsinfa,/  it)).  (16) 

Keeping  only  the  low-frequency  components  of  the 
signals  j  and  y2.  we  find  that 

.Vi(0  =  +  PR^,(r)  -  \PRdl  cos(a(M  - 

-  \P{di  sin(a(r)  - 

y2(t)  =  jPiOiit)  +  jPRdx  sin(a(f)  -  ad(r)) 

-  \Pxdx  cos(a(t)  -  ad(r)),  (17) 

and  the  result  is  obtained. 


’e^t)  -  diCOsioit)  -  !Xd(t)) 
dx  sin(a(f)  -  ccd(t)) 


,(15) 


Comments.  The  elimination  of  the  high-frequency 
components  within  the  system  can  be  achieved  by 
proper  low-pass  filtering  of  the  signals  yx(t)  and 
y2(t).  In  the  algorithm  discussed  in  this  paper,  the 
signals  are  applied  to  a  compensator  C(s)  which  is 
low-pass  in  nature.  Although  the  filtering  is  far 
from  ideal,  simulations  show  that  our  approxima¬ 
tions  are  satisfactory  for  the  compensator  design 
without  the  need  for  additional  filtering. 

3.3.  Compensator  design 

Equation  (15)  can  be  viewed  as  an  alternative 
description  of  the  plant,  with  two  inputs  ()x  and 
a  and  two  outputs  yx  and  y2.  Although  this 
equation  is  nonlinear,  a  linear  system  is  obtained  if 
the  phase  error  a  —  <xd  is  small.  This  system  is 
described  by 

yi®  =c|"  1  -(18) 

J'zWJ  Ui(a(f)  -  aj(f))J 

Using  this  linearized  result,  several  methods  for 
designing  C(s)  can  be  used.  Our  approach,  while 
not  the  best  or  the  m'ost  sophisticated,  yields 
a  simple  design  for  implementation  purposes.  We 


define  two  variables  xx  and  x2  as 


so  that 

pi«i  r  odt)-di 

Lx2(d  U(f0  @z(e)  -  a>i)d°  +  a(°)  -  «*(0)L 

(20) 

As  a  result,  the  dynamics  of  the  system  from  the 
parameters  0X  and  02  to  the  variables  x{  and  x2  are 
decoupled  from  one  another  and  are  those  of  a  gain 
of  1  and  of  an  integrator  with  a  gain  du  respec¬ 
tively.  The  unknown  parameters  dx,  (ox,  a^O)  act  as 
constant  disturbances.  The  compensator  C(s)  may 
then  be  designed  as  the  cascade  of  the  transforma¬ 
tion  (19)  and  control  laws  of  the  form 


N 


.S' 


(21) 


where  the  integrators  are  included  to  reject  the 
disturbances  composed  of  and  aj(0).  The  transfer 
functions  C j (.v)  and  C2(s)  are  designed  to  guarantee 
the  closed-loop  stability  of  the  two  systems 
Px(s)  =  1  and  P,(.s)  =  djs.  One  possible  choice  is 

C|(S)  =  -</,,  C\(s)  =  —  (22) 

s  +  b 


Because  the  magnitude  of  the  disturbance  d  t  acts  as 
a  gain  in  the  second  transfer  function,  the  para¬ 
meters  of  the  compensator  C2(s)  must  be  designed 
for  a  range  of  magnitudes  of  the  disturbance  dx. 
Simple  techniques  can  also  be  used  to  estimate  the 
disturbance  level  before  the  system  is  turned  on. 

The  algorithm  requires  the  knowledge  of  the 
matrix  G,  which  depends  on  a>{.  Similar  to  the 
indirect  algorithm,  one  can  resolve  this  problem  in 
two  ways.  One  may  choose  to  design  a  compen¬ 
sator  that  works  satisfactorily  for  a  range  of  ma¬ 
trices  G  corresponding  to  a  range  of  frequencies  of 
the  unknown  disturbance.  Often,  the  uncertainty  in 
the  frequency  of  the  disturbance  is  small  enough 
such  that  variations  in  the  G  matrix  are  incon¬ 
sequential,  yielding  adequate  performance  for 
a  compensator  designed  for  a  mid-range  distur¬ 
bance  frequency.  Alternatively,  one  could  use  for 
G  the  equivalent  transfer  function  matrix  corres¬ 
ponding  to  the  estimated  frequency  a  =  02.  In 
either  case,  knowledge  of  the  frequency  response 
of  the  plant  in  the  frequency  range  of  interest  is 
required. 


3.4.  Simulations  of  the  direct  algorithm 
*  We  now  explore  the  performance  of  the  direct 
algorithm  via  simulation.  We  consider  the  same 
situation  as  in  the  indirect  algorithm,  in  which 
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P(s)  =  100/($  4- 100),  cox  =  100,  and  dx  =  1.  For 
the  direct  algorithm,  the  parameter  gx  is  set  to  10, 
leading  to  a  closed-loop  pole  for  the  first  system  at 

—  10  rad/s.  The  other  parameters  are  set  to 
g2  —  400,  a  =  5,  and  b  =  30,  leading  to  three 
closed-loop  poles  for  the  second  system  located  at 

-  10  rad/s  and  -  10  ±  jlO  rad/s.  The  initial  states 
of  all  parameters  are  zero  except  for  0i(O)  =  0.9, 


02(O)  =  90  rad/s,  and  a(0)  =  90o.  Note  that,  since 
a<1(0)  =s  0,  the  system  is  initialized  with  a  large 
phase  error,  such  that  the  linearized  analysis  is  less 
accurate. 

Figure  6  shows  the  log  of  the  output  of  the  plant. 
The  output  is  found  to  decrease  to  negligible  values 
in  less  than  two  seconds.  The  transient  behavior  of 
the  magnitude  estimate  8X  is  shown  in  Fig.  7,  where 


Fig.  7.  Magnitude  estimate  for  the  direct  algorithm. 
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the  solid  line  is  the  parameter  response,  the  dashed 
line  is  the  response  predicted  using  the  nonlinear 
approximation  in  (15),  and  the  dot-dashed  line  is 
the  response  predicted  using  the  linear  approxima¬ 
tion  in  (18).  The  equivalent  behaviors  of  the  actual 
and  theoretically-predicted  values  of  the  frequency 
estimate  92  are  shown  in  Fig.  8.  Note  that  the 
matches  between  the  theoretical  and  actual  behav¬ 
iors  of  the  estimates  are  particularly  good  when 
using  the  nonlinear  approximation,  whereas  the 
analysis  using  the  linear  approximation  is  only 
accurate  for  the  frequency  estimate.  Although  the 
nonlinear  effects  are  clearly  significant,  our  design 
based  on  the  linear  approximation  provides  ad¬ 
equate  convergence  of  the  system. 

In  these  simulations,  the  system  converged  des¬ 
pite  a  10%  initial  error  in  frequency.  It  was  found 
that  the  scheme  was  able  to  acquire  frequencies 
with  errors  up  to  30%  in  this  case.  It  is  well-known 
that  an  important  characteristic  of  phase-locked 
loops  is  their  lock-in  (or  pull-in)  range  (Hamblev, 
1990).  Careful  design  of  the  loop  transfer  function 
can  increase  the  lock-in  range  and  improve  perfor¬ 
mance.  Additional  supervisory  logic  might  also  be 
used  for  acquisition,  and  would  be  part  of  a  practi¬ 
cal  design.  In  addition,  although  the  elements  of 
G  were  set  to  their  nominal  values  corresponding  to 
a  disturbance  frequency  of  100  rad/s  for  these  plots, 
„  simulations  with  the  nominal  G  replaced  by  a  con¬ 
tinuously-adjusted  matrix  according  to  the  esti¬ 
mated  frequency  of  the  disturbance  did  not  exhibit 
significant  differences  in  transient  behaviors.  Other 


simulations  with  slowly  varying  disturbances 
and  with  measurement  noises  indicate  that  the  di¬ 
rect  algorithm  performs  well  in  these  situations, 
and  the  effects  of  these  variations  can  be  analyzed 
precisely  using  the  linear  approximation,  as 
described  in  Bodson  and  Douglas,  (1996)  and 
Bodson,  (1996). 


4.  CONCLUSIONS 

In  this  paper,  we  have  presented  two  methods  for 
the  rejection  of  sinusoidal  disturbances  with  un¬ 
known  frequency.  While  disturbance  rejection  for 
signals  with  known  frequency  has  been  addressed 
extensively  in  the  literature  using  various  ap¬ 
proaches,  the  analogous  task  for  signals  with  un¬ 
known  frequency  has  received  comparatively  little 
attention  despite  its  importance  in  applications 
such  as  active  noise  and  vibration  control.  Our 
study  of  an  algorithm  for  the  determination  of  the 
frequency  of  an  unknown  signal  yielded  an  aver¬ 
aging  analysis  that  was  useful  for  system  design.  It 
was  shown  that  this  frequency  estimation  algo¬ 
rithm  could  be  combined  with  an  AFC  algorithm 
to  obtain  an  indirect  algorithm  for  the  cancellation 
of  disturbances  with  unknown  frequency.  While 
this  system  was  able  to  lock  on  a  sinusoidal  signal 
with  no  a  priori  information  about  the  frequency  of 
the  disturbance,  the  convergence  properties  of  the 
scheme  were  found  to  be  less  than  ideal.  A  second 
algorithm  incorporating  a  phase-locked  loop 
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within  the  cancellation  scheme  yielded  improved 
convergence  properties,  and  our  averaging  analysis 
provided  a  precise  prediction  of  the  dynamic  char¬ 
acteristics  of  the  system.  A  successful  scheme  for 
sinusoidal  disturbance  cancellation  scheme  would 
combine  the  direct  algorithm  presented  here  with 
an  initialization  scheme  for  providing  rough  initial 
estimates  of  the  disturbance  frequency.  Simulations 
verified  the  results  of  the  analysis  and  indicated  the 
usefulness  of  the  algorithms  for  the  sinusoidal  dis¬ 
turbance  cancellation  task. 
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ABSTRACT 

Two  adaptive  algorithms  that  reject  narrowband  disturbances  of  unknown  frequency  are  compared.  The  first  is 
based  on  an  adaptive  implementation  of  the  internal  model  principle.  The  second  is  based  on  a  phase-locked  loop 
structure  and  generates  a  signal  whose  magnitude  and  phase  match  those  of  the  disturbance.  The  adaptive  internal 
model  principle  algorithm  provides  global  stability  under  ideal  conditions,  tracks  reference  inputs,  and  can  stabilize 
unstable  plants.  However,  the  algorithm  suffers  from  convergence  and  robustness  problems  in  simulations  and  does 
not  appear  to  be  well-suited  to  high-order  systems  or  systems  with  unknown  time  delays,  two  situations  that  are 
typically  encountered  in  active  noise  control  applications.  The  algorithm  based  on  the  phase-locked  loop  concept 
has  better  convergence  and  robustness  properties  and  can  be  applied  to  a  broad  range  of  stable  systems.  Some  prior 
information  is  required  about  the  magnitude  and  frequency  of  the  disturbance  and  about  the  frequency  response 
of  the  plant,  however.  A  real-time  implementation  of  the  phase-locked  loop  scheme  in  an  active  noise  control  task 
provides  a  25  dB  reduction  of  a  sinusoidal  tone  of  unknown  frequency. 

Keywords:  adaptive  control,  signal  processing,  periodic  disturbances,  phase-locked  loops,  active  noise  control. 

1.  INTRODUCTION 

We  consider  the  problem  of  attenuating  an  output  signal  y(t)  that,  in  the  Laplace  domain,  is  given  by 

y(s)  =  P(s)(u(s)-d(*)),  (1) 

where  u(s)  and  d(s)  are  the  Laplace  transforms  of  the  controller  output  and  disturbance  signals,  respectively,  and 
P(s)  is  the  Laplace  transform  of  the  impulse  response  of  the  plant.  The  plant  is  assumed  to  be  linear  and  time- 
invariant.  The  goal  of  the  control  system  is  to  generate  u(2)  such  that  y(t )  —  0  as  /  —  oc.  We  assume  that  the 
disturbance  d(t)  is  a  sinusoid  of  fixed  magnitude  9\m  and  fixed  frequency  u )\ 

d{t)  =  9i "  cos(ad{t )), 

—  u jx.  (2) 

In  this  task,  the  parameters  9-/ ,  u;i,  and  0^(0)  are  all  unknown. 

The  problem  formulation  is  typical  of  active  noise  control  problems  with  a  periodic  noise  source  [1].  For  simplicity, 

it  is  assumed  that  a  single  tone  is  present,  although  the  algorithms  of  the  paper  can  be  extended  to  multiple  tones. 

Feedback  algorithms  are  considered  because  a  separate  measurement  of  the  disturbance  may  not  be  available  or  may 
be  costly  to  acquire.  Such  algorithms  are  more  difficult  to  design  than  the  adaptive  feedforward  control  algorithms 
that  are  often  used  in  active  noise  control  tasks. 
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One  approach  to  this  problem  is  an  adaptive  implementation  of  the  internal  model  principle  of  the  form  proposed 
in  [2],  [3],  and  [4].  The  algorithms  address  a  broad  class  of  problems,  including  those  in  which  the  plant  is  unknown 
and  a  reference  input  must  be  tracked.  In  this  paper, we  compare  the  respective  advantages  and  disadvantages  of 
these  approaches  with  an  alternative  approach  employing  a  phase- locked  loop  within  the  system  [5],  [6].  As  we  shall 
show,  the  implementation  of  the  internal  model  principle  algorithms  presents  some  practical  difficulties  that  are 
largely  overcome  by  the  phase-locked  loop  algorithm. 

2.  ADAPTIVE  INTERNAL  MODEL  PRINCIPLE 


2.1  Algorithm 

The  internal  model  principle  prescribes  that  the  transfer  function  of  a  feedback  control  system  designed  to  reject 
a  sinusoidal  disturbance  of  frequency  jw:  should  have  a  pair  of  poles  at  s  =  ±jUl.  The  infinite  loop  gain  at 
the  frequency  ensures  that  the  sinusoidal  disturbance  is  perfectly  rejected  if  the  closed-loop  system  is  stable. 
This  objective  can  be  realized  for  disturbances  of  unknown  frequency  and  for  unknown  plants  with  an  adaptive 
implementation  of  the  internal  mode!  principle.  The  algorithms  proposed  by  [2],  [3],  and  [4]  are  obtained  from 
standard  adaptive  control  theory  by  choosing  an  overparameterized  compensator.  For  a  plant  of  order  n  that  would 
normally  require  a  controller  of  order  2 n  -  2,  a  controller  of  order  2n  +  2  is  chosen.  The  four  extra  degrees  of  freedom 
are  used  to  force  some  of  the  poles  of  the  compensator  onto  the  the  jkc-axis.  Adaptation  is  employed  to  ensure  that 
the  poles  converge  to  the  desired  locations  on  the  jut-axis,  thereby  rejecting  the  disturbance. 


d 


Figure  1:  Adaptive  Scheme  Based  on  the  Internal  Model  Principle 


For  illustration,  consider  the  scheme  of  [2],  as  shown  in  Fig.  1.  This  figure  is  identical  to  that  on  p.  302  of  [2], 
except  for  a  difference  in  the  sign  convention  for  the  disturbance.  This  particular  realization  assumes  that  P(s)  is  a 
first-order  plant  of  the  form 


P(s)  = 


yp(s) 


(3) 


u(«s)  5  +  ap  * 

where  the  parameters  kp  and  ap  are  unknown.  The  scheme  can  be  extended  to  higher-order  plants  by  increasing 
the  order  of  the  filters  and  the  number  of  adaptive  parameters.  The  control  objective  is  to  track  the  output  of  a 
reference  model  M(s)  with  reference  input  r(t)  and 


m(s)  =  iJidfl  =  -i*L_ 

r(s)  s  +  alU 


(4) 
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In  this  system,  k\i  and  ajv*  are  design  parameters.  The  control  law  is  given  by 


it(t)  =  k(t)r(t)  -f  ci(<)u;i(<)  +  c2(t)w2(t)  +  0(t)yp(t)  -f  di(0u>3(0  +  dnitjw^t). 

The  signals  w\,  w2,  ^3,  tu4  are  determined  by 

s  1 

u>i(s)  =  e  ■  „  u(st  u’2(s)  =  ;  .  ,  „  «(«). 

S"  +  QiS  +  ao  S"  +  a^s  -f-  a2 


s  1 

xv3(s)  =  yrr~r~T~:  yp(s)>  and  w*(s)  = 


i>“  +  a  1  s  +  a  2 
The  adaptive  parameters  are  updated  according  to 


8 — h  (i\S  4-  a2 


yr($)- 


L(t)  -  -(jeo(t)r(t),  9(t)  =  -<jert[t)yp(t).  c2(t)  =  -geo(t)u'2(t). 

d\ (<)  =  -geo[t)u-;i(t).  d2[t)  =  — «/«ro  (/ )*r^(£ ). 

where  g  >  0  is  an  adjustable  adaptation  gain  and 

^o(M  =  yp[t)  -  y.u{t) 


(5) 

(6) 

(7) 


(8) 

(9) 


is  the  output  error. 

Fora  first-order  plant  without  an  input  disturbance,  a  similar  compensator  without  the  signals  w\,  w2,  u'3,  and  a:  4 
can  be  used,  and  only  the  two  parameters  k  and  9  are  adapted.  In  the  presence  of  the  disturbance,  the  compensator 
is  the  same  as  the  one  that  would  have  been  used  for  a  third-order  plant  without  the  disturbance.  In  this  system, 
however,  the  parameter  c  1  is  fixed  at  a  value  such  that  thr  loop  transfer  function  for  constant  parameters,  given  by 

s'  +  ais-!-nv  kp  &($•  4-  a\S  4*  a2)  -b  ( </ 1 *  +  d2)  . 

m*)  =  t~  7 - : — rr - 7' — : - - - ~ - : - '  (1U) 

S~  -h  ( u  1  —  c*i  )s  -r  (a*j  —  c2 )  s  -r  ap  S~  r<l]  >*  -f  <!•_> 

has  a  pair  of  poles  on  the  jw-axis.  This  will  be  the  case  when 

c;  =  1/1.  (11) 

c;  =  «2-^l  (12) 


In  the  algorithm,  c  1  is  chosen  according  to  (11),  while  c2  is  updated  according  to  (S)  as  the  frequency  u j\  is  unknown. 

The  nominal  values  for  the  other  parameters  are  obtained  by  calculating  the  closed-loop  transfer  function  for 
constant  parameters,  which  is 

=  -  — £+*±±2. - ..-t-.n-ii.r1  (i3) 

r(s)  s-  +  ( a  1  —  ci)s  r  [a2  —  c->)  s  +  ap 


The  transfer  function  matches  the  reference  model  transfer  function  (4)  for  the  nominal  parameter  values 


k\j  ap  -  clm  -  a  1  aj  -  cs  -  axap  a2ai  -  c2ap 

K  —  - ,  U  —  - ,  CL,  —  - .  (in  —  - , 

kp  kp  kp  “  &P 


(14) 


2.2  Simulation  Results 

The  scheme  has  several  useful  features,  including  its  capabilities  to  control  unknown  plants,  to  stabilize  unknown 
plains,  to  reject  disturbances  of  unknown  frequencies,  and  to  track  arbitrary  reference  inputs.  These  properties  are 
explored  in  a  simulation  in  which  kp  =  2.  ap  =  —1.  k\j  =  1,  <23/  =  2,  ay  =  3,  ao  =  2.  and  g  =  1.  The  reference 
input  is  r(£)  =  10  and  the  disturbance  is  d(t)  =  — 2sin(5t).  All  the  initial  conditions  are  zero,  except  for  yiwiO)  =  1 
and  &(0)  =  0.5.  In  addition,  the  estimate  k  is  kept  constant  for  the  entire  simulation  instead  of  being  updated  and  is 
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t  > 


equal  to  the  nominal  value  km  =  0.5.  These  conditions  are  the  same  as  those  used  in  a  simulation  from  [2].  Indeed, 
pig  2  is  essentially  a  replica  of  a  figure  found  on  p.  302  of  [2].  In  Fig.  2,  the  solid  line  is  the  plant  output  yp 
and  the  dashed  line  is  the  reference  model  output  yM .  Note' that  the  plant  is  unstable,  so  that  both  stabilization 
of  the  unknown  plant  and  tracking  of  the  reference  input  are  achieved.  However,  rejection  of  the  disturbance  is  not 
obtained;  a  large  oscillation  remains  after  6  seconds. 

Fig.  3  shows  a  similar  simulation,  except  that  r(t)  =  0  and  y\f{ 0)  =  0.  The  output  is  shown  for  two  values  of  the 
gain:  the  solid  line  is  for  g  =  1  and  the  dashed  line  is  for  g  =  10.  The  output  again  exhibits  a  large  residual  error, 
although  it  appears  to  converge  to  zero.  A  close  examination  at  the  responses  indicates  that  the  convergence  of  the 
amplitude  of  the  error  is  approximately  of  the  order  of  l/y/i ,  which  is  very  slow.  Moreover,  increasing  the  adaptation 
gain  g  by  a  factor  of  10  only  reduces  the  error  by  a  factor  of  two.  as  seen  in  Fig.  3.  Fig.  4  shows  the  adaptive 
parameters  C2  (left)  and  0  (right).  Again,  the  solid  lines  are  for  g  =  I  and  the  dashed  lines  are  for  g  =  10.  One 
finds  that  03  remains  far  from  the  nominal  value  co"  =  -23  which  would  guarantee  the  rejection  of  the  disturbance 
by  virtue  of  the  internal  model  principle.  On  the  other  hand,  the  feedback  gain  0  far  exceeds  its  nominal  value  of 
9*  =  —3.  It  appears  that  the  error  is  reduced  through  a  large  feedback  gain  9  rather  than  through  the  convergence 
of  C2  to  its  nominal  value  in  this  situation.  Thus,  the  principle  upon  which  the  scheme  was  developed  is  not  realized. 


Figure  4:  Responses  of  Co  (left)  and  0  (right) 


The  lack  of  good  convergence  properties  for  this  scheme  may  be  expected  to  lead  to  poor  robustness  properties 
in  the  presence  of  unmodelled  plant  dynamics.  Indeed.  Fig.  5  shows  the  result,  of  a  simulation  in  which  the  plant  is 


P(s) 


lep  229 

s  +  ap  s-  4*  30s  4-  229 


(15) 


The  unmodelled  dynamics  represented  by  the  second  term  in  (15)  are  those  of  the  well-known  "Rohrs  examples"  (]7:. 
[8])  and  represent  relatively  mild  modifications  to  the  original  plant.  Yet,  the  output  of  the  plant,  shown  on  the  left 
of  Fig.  5,  rapidly  diverges.  On  the  right  of  the  figure  is  the  trajectory  of  the  adaptive  parameter  9 .  which  is  seen  to 
reach  large  negative  values  and  is  likely  to  be  the  cause  of  the  instability. 

2.3  Alternative  Design  Options 

It  is  possible  to  alleviate  some  of  the  problems  discussed  in  section  2.2  by  making  alternative  design  choices  with 
the  algorithm’s  structure.  For  the  convergence  problems,  one  possible  remedy  is  the  use  of  richer  reference  inputs. 
Unfortunately,  simulations  in  which  r(?)  consisted  of  several  sinusoids  did  not  produce  good  results.  Moreover,  zero 
reference  inputs  are  common  in  active  noise  and  vibration  control  problems.  A  better  option  would  be  to  replace 
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Figure  5:  Responses  of  yP  (left)  and  &  (right)  with  Unmodelled  Dynamics 

the  pseudo-gradient  algorithm  (8)  by  a  least-squares  algorithm.  However,  this  change  would  require  a  different 
adaptation  structure  with  a  more  complicated  adaptation  rule. 

As  for  the  robustness  problems,  it  is  noted  that  the  control  system  is  not  robus,  for  settings  at  the  nominal 
parameter  values.  In  the  example  of  Section  2.2,  the  loop  transfer  function  with  the  nominal  parameters  provides 
only  a  gain  margin  of  Lol  dB  and  a  phase  margin  of  18  degrees.  These  low  margins  can  be  attributed  to  the  fact 
that  the  plant  is  unstable  and  that  poles  «,=  !.,  =  ±5 j  are  moved  to  distant  locations  at  s  =  -1  ,  =  _! 
s  --2.  A  higher  level  of  robustness  is  obtained  if  the  open-loop  plant  is  stable  and  if  the  observer  poles  (the  roots 

of  s-  +  a  ,  4 •  «3)  are  placed  at  values  closer  to  s  =  ±M.  This  placement  requires  some  prior  knowledge  about  thl 
value  of  the  frequency  of  the  disturbance. 


Figure  6:  Plant  Output  with  Unmodelled  Dynamics  and  Improved  Design 

Simulations  ware  performed  with  He  plant  pole  and  the  reference  model  pole  a,  a  =  -  I  and  rhe  observe,  pole, 

'  '  “  -  J  gli”  m"S,n  “  “»  P''~  margin  is  to  90  dec,,.  The 

adapt,,,  parameters  were  also  initialized  a,  values  dose,  to  the  nominal  values.  Specific,!!,,  the  initial  parameters 

4°53:  Th  l°  7”“*'  7“  T“  “d  “  *  <“StU">an"  “  m  »<  the  true  freguencv,  „ 

4.5  r,d/s.  The  output  yP  ,s  shown  Fig.  6.  indicating  .ha,  the  algorithm  is  stable  in  this  si, nation.  Small  values 
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of  the  error  are  also  reached.  However,  a  large  adaptation  gain  of  g  =  100  had  to  be  used  to  obtain  this  result. 
The  large  gain  may  pose  potential  problems  in  the  presence  of  measurement  noise.  Nevertheless,  the  plot  shows 
that  much  better  robustness  properties  can  be  achieved  with  proper  design  and  initialization,  provided  that  prior 
information  is  available  about  the  plant  and  about  the  disturbance. 

3.  MAGNITUDE/PHASE  LOCKED  LOOP  SCHEME 


3.1  Algorithm 

In  this  section,  we  discuss  another  algorithm  that  is  based  on  a  magnitude/phase  locked  loop  concept.  The  scheme 
is  shown  in  Fig.  7.  It  is  similar  to  a  phase  locked  loop,  except  that  the  disturbance  signal  is  matched  both  in  phase 
and  magnitude.  The  scheme  is  quite  different  from  the  scheme  based  on  the  internal  model  principle  in  Fig.  1.  The? 
reference  input  is  absent,  i.e.,  it  is  zero.  In  addition,  the  plant  is  assumed  tu  be  stable. 


Figure  7:  Magnitude/ Phase  Locked  Loop  Schemer 


In  the  figure.  9\  is  the  estimate  of  the  magnitude  of  the  disturbance  signal,  and  do  is  the  estimate  of  its  instanta¬ 
neous  frequency.  Moreover,  a-  is  the  estimate  of  the  phase  of  the  disturbance  signal  and  is  the  integral  of  the  estimate 
of  the  frequency  do.  The  equations  for  the  control  algorithm  are 

«(0  =  0i(f)COS(or(/)). 

a(t)  =  *2(0, 

Vi  (0  =  2/(0cos(a(0). 

Jfe(0  =  -2/(0sin(a(0).  (10) 

The  last  part  of  the  algorithm  is  the  transfer  function  matrix  relating  the  signals  y±  and  y o  to  the  parameters  9 1  and 
*2-  Its  design  is  based  on  the  following  result. 

Fact:  Assume  that 

•  The  signals  di  and  On  vary  sufficiently  slowly  that  the  output  of  the  plant  to  the  signal  u  can  be  approximated 
by  the  steady-state  response  for  a  sinusoidal  input  with  frequency  do. 

•  The  instantaneous  frequency  do  is  close  to  such  that  P{j02)  can  be  replaced  by  P(j+ 1). 

Then,  considering  low-frequency  components  only,  the  two  signals  y\(t)  and  t/o (f)  are  approximately  given  by 

’  2/l(0 

.  ite(  0 


-  Q 

9i(t)  -  di  cos (a(f)  -  a-,i(/)) 

dy  sin(a(<)  -  ad(t)) 

(ID 
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where  G  is  defined  by 


G=\  p*  ,  PR  =  Re{P(M)l  PI  =  Im[P( M)\. 


Proof:  Under  the  assumptions,  the  output  of  the  plant  is  given  by 

y(t)  =  PR$x(t)  cos(a(t))  -  Pi0i(t)sin(a(t))  -  PRdi  cos(ad(t))  +  P/<ft  sin^O)-  (19) 

Keeping  only  the  low-frequency  components  of  the  signals  y\  and  yo»  we  find  that 

e/i (<)  =  ^PR0i{t)  ~  z;PRdicos{a{t)  -  ad(t))  -  ^Pidisin(a(t.)  -  ad(t)). 

1/2(0  =  ^P/<?i(0  +  iPfirfisin(Q(0  -  Orf(0)  -  7yPi<l\  cos(a(0  -  a<j(f)),  (20) 

and  the  result  is  obtained. 

The  elimination  of  the  high-frequency  components  within  the  system  can  be  achieved  by  low-pass  filtering  of  the 
signals  yi(t)  and  t/o(*)*  In  the  algorithm  discussed  in  this  paper,  the  signals  are  applied  to  a  compensator  which  is 
low-pass  in  nature.  Although  the  filtering  is  far  from  ideal,  simulations  show  that  the  approximation  is  satisfactory 
for  the  compensator  design  without  the  need  for  additional  filtering. 

Equation  (17)  can  be  viewed  as  a  new  description  of  the  plant,  with  two  inputs  Q\  and  and  two  outputs  y\ 

and  yn.  Recall  that  a  is  the  integral  of  the  signal  $•*.  A  linear  system  is  obtained  if  the  phase  error  a  —  aj  is  small. 

The  system  is  then  described  by 

2fi(0  _  r  9i(t)  ~ 

.  toll)  J  |  dx(a(t)-ad(t))  J  '  1  j 

Defining  two  variables  x\  and  j:o  as 


one  finds  that. 

"  a;  (0  1  Oi(t)  —  d\ 

.  *•.-(<)  J  =  di(^J  (^(^)-^iMo-  +  «(0)-«d(0)j  (23) 

As  a  result,  the  dynamics  of  the  system  from  the  parameters  9\  and  0o  to  the  variables  X\  and  x'2  are  decoupled  from 
one  another  and  are  those  of  a  gain  of  1  and  of  an  integrator  with  a  gain  cC,  respectively.  The  unknown  parameters 
d  1,  u;x,  <^(0)  act  as  constant  disturbances  at  the  input  of  the  system. 

Simulations  have  shown  that  satisfactory  performance  is  obtained  when  the  compensator  is  designed  using  linear 
techniques.  We  choose  it  to  be  the  cascade  of  the  transformation  (22)  and  control  laws  of  the  form 

0  -  Cl(s)r,  1 

01  —  - |*l  , 

S 

62  =  —[*2],  (24) 

s 

where  the  integrators  are  included  to  reject  the  disturbances  composed  of  d\  and  u<f(0).  The  transfer  functions  Ci(s) 
and  Co (s)  must  guarantee  the  closed-loop  stability  of  the  two  systems  Pi (5)  =  1  and  Po(s)  =  d\/s.  A  simple  choice 


Ci(s)  =  -gu 


Co(s)  =  -yd 


The  closed-loop  pole  for  the  first  system  is  placed  at  some  desired  value,  say  —  and  the  closed-loop  poles  for  the 
second  system  are  placed  at  —  —  sd  db  jsd.  by  setting 

A  2 

gi-sd,  a  =  — ,  6  =  g2  =  (26) 

a  cix 
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Because  the  magnitude  of  the  disturbance  d\  acts  as  a  gain  in  the  second  transfer  function,  the  gain  of  the  compensator 
C2(s)  depends  on  am  estimate  of  the  magnitude.  The  algorithm  also  requires  an  estimate  of  the  matrix  G ,  i.e.,  an 
estimate  of  the  frequency  response  of  the  plant  around  cj:.  Often,  the  uncertainty  in  the  frequency  of  the  disturbance 
is  small  enough  that  errors  in  the  G  matrix  are  inconsequential.  Alternatively,  one  could  use  for  G  the  value  of  the 
frequency  response  at  the  estimated  frequency  d  =  $2-  In  either  case,  knowledge  of  the  frequency  response  of  the 
plant  in  the  frequency  range  of  interest  is  required. 

3.2  Simulation  Results 


Figure  8:  Plant  Output 


Figure  9:  Magnitude  Estimate  (left)  and  Frequency  Estimate  (right) 


The  performance  of  the  algorithm  was  evaluated  via  simulation.  We  consider  the  same  case  as  in  Fig.  6,  with 
P(s)  =  l/(s-f-  1),  =  o,  d\  =  2,  and  o^(0)  —  —90  degrees.  The  initial  states  arc?  all  zero  except  for  tfj(O)  =  1 .8  and 

^2(0)  =  4.5  rad/s,  corresponding  to  10%  initial  errors  in  magnitude  and  frequency.  The  matrix  G  is  calculated  usins 
the  initial  estimate  of  the  frequency.  Since  or(0)  =  0  degrees  and  od(0)  =  -90  degrees,  the  system  is  initialized  with 
a  phase  error  out  of  the  linear  region.  Fig.  8  shows  the  output  of  the  system,  which  is  found  to  rapidly  converge  to 
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Time  (s)  Time  (s) 


Figure  10:  Plant  Output  with  Unmodelled  Dynamics 

zero.  Fig.  9  shows  the  magnitude  estimate  on  the  left  and  the  frequency  estimate  0o  on  the  right.  The  solid  lines 
are  the  estimates,  the  dashed  lines  are  obtained  by  integrating  the  equations  with  the  linear  approximation  in  (21) 
and  the  dot-dashed  lines  are  obtained  using  the  nonlinear  approximation  in  (IT).  The  nonlinear  approximation  is 
found  to  represent  very  well  the  transient  response  of  the  system,  although  the  linear  approximation  is  sufficient  to 
produce  a  successful  design. 

Fig.  10  on  the  left  shows  the  controller  output  in  the  presence  of  the  unmodelied  dynamics  in  (15).  Stability 
is  preserved,  although  the  convergence  of  the  error  to  zero  is  slower.  On  the  right  of  Fig.  10  is  a  similar  response, 
except  that  the  G  matrix  is  obtained  by  using  the  true  frequency  response  of  the  plant  at.  the  initial  estimate  of  the 
frequency  (4.5  rad/s).  One  finds  that  the  speed  of  convergence  is  restored  if  the  true  frequency  response  is  used.  The 
frequency  response  can,  in  general,  be  obtained  in  a  tuning  phase  of  the  algorithm. 

3.3  Experimental  Results 

The  scheme  was  implemented  in  an  experimental  active  noise  control  system  under  development  at  the  University  of 
Utah.  This  system  employs  a  Motorola  DSP96002  32-bit  floating-point  digital  signal  processor.  The  sampling  rate  for 
all  signals  was  8  kHz.  A  single  bookshelf  speaker  with  a  4-inch  low-frequency  driver  located  approximately  2  ft  away 
from  the  error  microphone  generated  a  pure  sinusoidal  tone  at  a  frequency  of  approximately  150  Hz.  The  microphone 
signal  was  passed  through  an  anti-aliasing  filter  and  sampled  by  a  self-calibrating  16-bit  analog-t.o-digital  converter 
before  being  sent  to  the  DSP  system.  The  noise  cancellation  signal  generated  by  this  system  was  sent  to  a  second 
speaker  placed  approximately  1  ft  away  from  the  microphone.  Only  the  error  sensing  microphone  signal  was  provided 
to  the  algorithm  for  the  controller  calculations.  The  frequency  response  of  the  plant  was  calculated  from  a  50-tap 
finite  impulse  response  filter  model.  The  coefficients  of  this  filter  were  determined  in  a  brief  identification  phase  in 
which  a  white  noise  signal  was  applied  to  the  noise  cancellation  speaker.  As  expected,  a  delay  of  approximately  8 
samples  was  observed  in  this  impulse  response. 

A  straightforward  transposition  of  the  phase-locked  loop  algorithm  to  the  discrete-time  case  was  implemented  in 
the  DSP-based  system  (cf.  [6]).  Fig.  11  shows  the  magnitude  of  the  error  signal,  as  measured  by  the  microphone 
in  the  experiment  and  plotted  in  dB.  For  the  first  0.5  seconds  of  the  experiment,  the  algorithm  was  not  engaged. 
Once  adaptation  commenced,  convergence  occurred  within  1  second  and  yielded  approximately  25  dB  reduction  in 
the  sound  output  at  the  error  microphone. 
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Figure  11:  Experimental  Plant  Output 

4.  CONCLUSIONS 

The  scheme  based  on  the  adaptive  internal  model  principle  lias  powerful  capabilities  by  enabling  the  stabilization  of 
unstable  plants  and  the  tracking  of  reference  inputs.  The  scheme  also  tolerates,  in  theory,  a  complete  uncertainty 
about  the  plant  parameters  and  about,  the  disturbance  frequency.  In  practice,  however,  significant  prior  information 
may  be  required  to  achieve  adequate  robustness  margins.  Ii  is  also  difficult  to  obtain  reasonable  convergence  rates 
with  a  pseudo-gradient  algorithm.  Implementation  of  the  algorithm  was  not  attempted  because  of  these  concerns 
and  because  it  is  difficult  to  apply  the  algorithm  to  the  case  where  the  order  of  the  plant  is  high,  or  where  there 
is  a  variation  in  time  delay.  The  discrete-time  implementation  for  a  finite  impulse  response  plant  model  with  50 
coefficients  would  require  104  adaptive  parameters. 

The  magnitude/phase  locked  loop  scheme  was  found  to  be  easier  to  implement  and  to  have  good  convergence* 
and  robustness  properties  for  an  active  noise  control  task.  A  linear  approximation  permitted  a  convenient  selection 
of  the  design  parameters  for  this  system.  The  scheme  assumes  that  the  plant  is  stable  and  that  the  reference  input 
is  zero,  two  conditions  that  are  reasonable  in  noise  control  applications.  To  use  this  scheme  effectively,  some  prior 
information  about  the  frequency  response  of  the  plant  as  well  as  the  magnitude  and  frequency  of  the  disturbance  is 
required. 
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Abstract 

The  paper  considers  the  problem  of  active  noise  control  without  feedforward  sensors  and  for  nar¬ 
rowband  disturbances.  Attention  is  focused  on  sinusoidal  disturbances,  although  the  methods  under 
consideration  may  be  extended  to  general  periodic  disturbances.  The  frequency  of  the  disturbance  is 
assumed  to  be  unknown.  Three  approaches  are  reviewed  in  the  paper:  the  adaptive  implementation 
of  the  internal  model  principle,  the  combination  of  adaptive  cancellation  techniques  with  frequencv 
estimation  algorithms,  and  the  direct  adaptation  of  the  magnitude,  frequency,  and  phase  of  the  control 
input.  The  respective  advantages  and  disadvantages  of  the  approaches  are  discussed  in  detail. 


1.  Introduction 


Figure  1:  Feedback  Active  Noise  Control 

A  single- channel  active  noise  control  system  is 
shown  in  Fig.  1.  A  speaker  produces  a  sound 
wave  that  is  adjusted  to  cancel  the  noise  gener¬ 
ated  by  an  external  source.  The  sound  intensity 
is  sensed  by  a  microphone  at  some  location  to  be 
made  quiet,  and  the  signal  is  applied  to  a  digital 
signal  processing  system  (DSP)  to  compute  the 
required  speaker  signal.  No  sensor  is  placed  on 
the  machine  that  is  the  source  of  the  disturbance, 
or  on  its  path,  so  that  feedforward  compensation 
is  not  possible. 

The  disturbance  is  assumed  to  be  periodic, 
which  is  a  common  situation  when  the  source  of 
the  noise  is  a  rotating  machine.  The  overall  set¬ 
up  is  then  referred  to  as  feedback  active  noise 
control  for  narrowband  disturbances  [1].  The 
frequency  of  the  disturbance  is  not  assumed  to 
be  known,  which  poses  significant  difficulties  and 
limits  the  number  of  techniques  that  may  be  ap¬ 


plied. 

Mathematically,  the  problem  is  stated  a s  fol¬ 
lows.  The  transformation  from  the  speaker  to  the 
microphone  is  assumed  to  be  that  of  a  stable  lin¬ 
ear  time-invariant  system  with  transfer  function 
P(s).  The  effect  of  the  noise  source  is  assumed 
to  be  additive,  and  the  disturbance  is  reflected  to 
the  location  of  the  speaker.  The  system  is  then 
modelled  by 

y{s)  =  P(s)(u(s)-d(s)),  (1) 

where  y(s),  u{s ),  and  d(s)  are  the  Laplace  trans¬ 
forms  of  the  microphone  signal,  of  the  speaker 
signal,  and  of  the  equivalent  noise  signal  at  the 
speaker  location,  respectively.  The  problem  may 
be  viewed  as  a  standard  feedback  control  prob¬ 
lem,  with  a  zero  reference  input  and  a  disturbance 
acting  at  the  input  of  the  plant.  P(s)  is  the  plant 
transfer  function,  y{t)  is  the  plant  output,  u(f)  is 
the  control  input,  and  d(t)  is  the  disturbance. 

The  goal  of  the  control  system  is  to  generate 
u(f)  such  that  y(t)  0  as  £  oc.  The  objective 
would  be  achieved  if  u(t)  =  d(t),  but  the  dis¬ 
turbance  d(i)  is  not  known  or  measured,  except 
through  its  effect  at  the  output  of  the  system. 
The  disturbance  is  of  the  form 

n 

d{l)  =  cos(oo(0)- 

k=l 

=  kui,  A;  =  1, ....  n. 


(2) 
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The  frequency  of  the  disturbance,  ui\ .  is  unknown. 
The  parameters  <f*  and  oyrjb(0)  specify  the  mag¬ 
nitudes  and  the  phases  of  the  harmonic  compo¬ 
nents,  and  are  also  unknown.  The  number  of  har¬ 
monics  n  is  assumed  to  be  finite  and  known.  Cer¬ 
tain  values  of  d*  may  be  assumed  to  be  zero.  For 
simplicity  of  presentation,  we  will  consider  pri¬ 
marily  the  case  where  only  the  fundamental  is 
present  (sinusoidal  disturbances). 


Figure  2:  Adaptive  Internal  Modei  Principle 

Three  approaches  are  considered  in  the  pa¬ 
per.  The  first  approach  is  based  on  the  adaptive 
implementation  of  the  internal  model  principle. 
The  concept  is  represented  in  Fig.  2.  The  inter¬ 
nal  model  principle  states  that  sinusoidal  distur¬ 
bances  of  frequency  will  be  perfectly  rejected 
if  the  feedback  compensator  has  poles  located  a; 
s  =  ±ju i  in  the  s-plane.  The  name  comes  from 
the  fact  that,  for  most  initial  conditions  and  in 
open-loop,  such  compensator  generates  sinusoidal 
signals  of  frequency  ;jj.  The  adaptive  implemen¬ 
tation  of  the  principle,  illustrated  in  Fig.  2,  might 
seem  straightforward.  However,  the  poles  and  ze¬ 
ros  of  C(s)  need  to  be  adjusted  as  ~’i  varies  to 
maintain  stability. 


d 


shown  in  Fig.  3  and  combines  an  adaptive  algo¬ 
rithm  for  the  cancellation  of  periodic  disturbances 
of  known  frequency  together  with  a  frequency  es¬ 
timation  algorithm.  The  adaptive  cancellation 
algorithm  estimates  9C  and  9S1  the  cos  and  sin 
components  of  the  control  input.  The  frequency 
estimation  algorithm  provides  an  estimate  9/  of 
the  frequency  of  the  disturbance,  which  is  inte¬ 
grated  to  obtain  a  phase  signal  a.  Under  ideal 
conditions,  the  phase  is  equal  to  the  phase  of  the 
disturbance  up  to  a  constant  angle  that  is  esti¬ 
mated  through  the  parameters  9C  and  9S.  The 
approach  is  called  indirect,  because  an  interme¬ 
diate  frequency  estimation  step  is  performed,  in¬ 
dependently  of  the  adaptation  to  the  magnitude 
and  phase  of  the  disturbance. 


Figure  4:  Direct  Approach 

Fig.  4  shows  the  concept  of  a  scheme  where 
the  estimation  of  the  magnitude,  frequency,  and 
phase  of  the  disturbance  are  all  performed  to¬ 
gether.  with  a  single  adaptation  mechanism.  9\  is 
the  estimate  of  the  magnitude  of  the  disturbance, 
9i  is  the  estimate  of  its  frequency,  and  a  is  the 
estimate  of  its  phase.  The  objective  of  the  adap¬ 
tation  scheme  is  to  provide  a  stable  closed-loop 
system  and  convergence  of  y(t)  to  zero. 

In  the  remaining  of  the  paper,  specific  imple¬ 
mentations  of  the  three  approaches  are  presented, 
and  their  respective  advantages  and  disadvan¬ 
tages  are  discussed.  Details  of  the  algorithms  are 
left  to  the  papers  cited  as  references. 

2.  Adaptive  Internal  Model 
Principle 


Figure  3:  Indirect  Approach 
The  second  approach  under  consideration  is 


The  internal  model  principle  has  been  considered 
as  a  constraint  on  adaptive  control  schemes  for 
unknown  plants.  Fig.  5  is  an  example  found  in 
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Figure  5:  Narendra  &  Annaswamy's  Example 


Figure  6:  Output  with  N.&A.’s  Example 

the  control  structure  of  an  adaptive  control  al¬ 
gorithm  for  a  first-order  system  with  unknown 
parameters  and  a  sinusoidal  disturbance  of  un¬ 
known  frequency.  The  parameters  k,  c2,  d,.  d2. 
and  9  are  updated  according  to  a  standard  gradi¬ 
ent  algorithm,  while  the  constraint  cj  =  m  Is  ap¬ 
plied  so  that  the  feedback  loop  has  a  pair  of  pole- 
on  the  jo;- axis.  Alternative  algorithms  based  on 
the  internal  model  principle  may  be  found  in  [3j. 
[4],  In  these  algorithms,  the  problem  of  adapt¬ 
ing  to  the  frequency  of  the  disturbance  is  solved 
together  with  the  problem  of  adapting  to  uncer¬ 
tain  plant  parameters.  In  addition,  tracking  of 
reference  inputs  is  possible,  and  unstable  plants 
may  be  stabilized.  In  other  words,  the  algorithms 
solve  a  much  more  general  problem  than  the  one 
stated  earlier. 

The  schemes,  however,  are  not  without  serious 
drawbacks.  Convergence  and  robustness  proper¬ 


ties  axe  generally  poor.  Fig.  6  shows  the  plant 
output  resulting  from  a  simulation  of  the  example 
of  Fig.  5  (this  figure  is  identical  to  a  figure  found 
ia  [2]).  The  dashed  line  shows  the  output  of  a  ref* 
orence  model,  which  the  plant  output  is  supposed 
to  Mow.  A  large  residual  error  is  visible.  While 
the  theoretical  results  guarantee  the  stability  of 
the  adaptive  system  and  the  convergence  of  the 
error  to  aero,  the  convergence  is  extremely  slow. 
It  also  turns  out  that  instabilities  result  from  very 
•mall  amounts  of  unmodelled  dynamics,  and  that 
the  schemes  based  on  the  internal  model  principle 
require  a  large  number  of  parameters  for  systems 
with  high  order  and  large  time  delays.  Fox  a  de¬ 
tailed  discussion  of  these  issues,  see  [5]. 

Overall,  the  approach  based  on  the  internal 
model  principle  offers  some  powerful  capabilities, 
but  these  capabilities  are  not  exploited  in  ac¬ 
tive  noise  control  problems.  Further,  weaknesses 
severely  limit  the  applicability  of  the  methods. 
Stability  and  robustness  issues  need  to  be  re¬ 
solved  before  these  schemes  can  be  practicallv 
useful. 


3.  Indirect  Approach 


0 
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Figure  7:  Output  with  Indirect  Scheme 

The  indirect  approach  to  periodic  disturbance 
cancellation  is  probably  most  intuitive.  Algo¬ 
rithms  for  the  adaptive  cancellation  of  periodic 
disturbances  of  known  frequency  are  widely  avail¬ 
able  and  work  well  (see,  for  example,  [6],  [7]). 
Frequency  estimation  algorithms  arc  also  numer¬ 
ous.  In  [8].  the  adaptive  cancellation  scheme  of 
[6]  was  combined  with  the  frequency  estimation 
algorithm  of  [9j .  An  unexpected  problem  was 
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Figure  8:  Modified  Indirect  Approach 
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mg  signal  is  equal  to  the  output  that  would  be 
observed  if  no  control  signal  was  applied  to  the 
plant.  Le..  the  component  that  is  due  to  the  dis¬ 
turbance  alone.  Fig.  9  shows  the  plant  output 
that  results  from  the  modification  applied  to  the 
scheme  considered  earlier.  Exponential  conver¬ 
gence  of  the  error  signal  is  observed.  One  might 
be  concerned  that  the  success  of  such  a  modified 
scheme  would  be  highly  dependent  upon  the  ac¬ 
curacy  of  the  estimate  of  the  plant  transfer  func¬ 
tion.  However,  simulations  have  not  confirmed 
such  a  concern. 

Overall,  the  modified  indirect  approach  is  very 
flexible.  The  modularity  of  the  design  aliows  one 
to  select  the  two  components  independently,  and 
each  from  a  iarge  number  of  possible  algorithms. 
On  the  other  nana.  analysis  is  difficult,  and  in¬ 
teractions  between  the  two  components  may  be 
complex  and  incompletely  understood. 


4.  Direct  Approach 


Fisrure  9:  Output  witr  Modihed  mctrec.  ochem^ 

discovered,  in  that  me  convergence  of  me  com¬ 
bined  scheme  was  found  to  De  slow.  x-;s  proc- 
lem  is  illustrated  in  Fig.  7.  which  snows  the  iog  of 
the  plant  output  for  a  simulation  of  me  indirect 
scheme.  As  one  can  see.  there  is  raoia  conver¬ 
gence  of  the  output  signal  towarcs  zero,  out  me 
convergence  slows  down  considerably  after  a  sec¬ 
ond.  The  problem  was  traced  to  tne  fact  teat, 
as  the  adaptive  algorithm  cancels  the  enec:  o: 
the  disturbance,  it  aiso  eliminates  tne  signal  upor. 
which  frequency  estimation  :s  basec.  resulting  :r. 
slow  convergence. 

While  tne  problem  may  seem  to  be  tied  to  the 
indirect  approach,  that  is  not  the  case.  A  modi¬ 
ned  indirect  aporoach.  shown  in  Fig.  t.  redes  cr. 
a  siErnai  for  froouency  estimation  mat  aoes  net 
converge  to  zero.  The  signal  is  oDtainec  ov  es t ; 
mating  me  uiani  output  y*  that  :s  due  to  me  cc:.- 
trot  input  !  using  an  estimate  of  tne  piaitt  transfer 
function  P,  >  -  ana  suDtracting  me  signal  from 

the  piast  output.  !f  Ptts-  =  P-s-.  tne  result- 
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Figure  10:  Direct  Scheme 

Fig.  10  snows  tne  biock  diagram  of  me  direct  al¬ 
gorithm  proposed  in  [10 J.  It  is  a  fairly  simple 
seneme.  which  can  be  translated  ;n  a  few  lines  of 
code.  In  the  figure.  G  is  a  2  x  2  matrix  given  by 

-  _  !  F* 

— — -  -p  _ 

where  Fpm  and  Fj  are  tne  real  part  and  imaginary 
par:  of  the  mart's  frequency  response  a:  .  The 
niter  F\$\  is  a  lead/iag  filter  with  integral  action, 
that  is  F' s  =  ,5  —  a)f'(s2  —  vs  The  variables 
g jai,  gzu?  arc  adjustable  gains.  Tire  :ree  parame¬ 
ters  are  cnosen  to  ensure  satisfactory  convergence 
properties 
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Figure  11:  Plant  Output  • 
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The  results  of  simulations  for  this  scheme  are 
shown  in  Fig.  11.  Fig.  12,  and  Fig.  13.  The  pa¬ 
rameters  of  the  simulation  are  given  in  [81.  The 
log  of  the  plant  output,  shown  on  Fig.  ex¬ 
hibits  a  similar  exponential  convergence  as  that 
of  the  modified  indirect  scheme.  Fig.  12  shows 
the  estimate  of  the  magnitude  B\ ,  and  Fig.  13 
shows  the  estimate  of  the  frequency  $2  ■  Both 
parameters  are  found  to  converge  rapidly.  The 
dashed  line  and  the  dot-dashed  line  show  the  re¬ 
sults  of  simulations  of  an  approximate  noniinear 
time- invariant  system  and  an  approximate  Linear 
time- invariant  system,  respectively.  The  approx¬ 
imations  are  found  ro  be  accurate,  especially  tor 
the  nonlinear  system,  and  were  obtained  using  an 
analysis  similar  to  the  averaging  analysis  that  is 
sometimes  applied  to  adaptive  systems  ;11  . 

The  noniinear  approximation  is  found  to  cap¬ 
ture  significant  noniinear  dynamics  of  the  mag¬ 
nitude  parameter.  Tiie  dynamics  oi  the  direct 
scheme  have  been  found  to  be  similar  to  those 
of  onase-iocked  loops.  In  fact,  the  scheme  may 
be  viewed  as  a  “magnitude/ phase-locked  ioop  . 
The  linear  approximation,  although  less  accurate, 
is  useful  for  the  selection  of  the  algorithm  s  pa¬ 
rameters.  Specifically,  the  parameters  may  be 
selected  to  achieve  ore-determined  convergence 
rates.  Further  analysis  using  the  linear  approxi¬ 
mation  leads  to  predictions  oi  the  effect  oi  siow 
variations  of  the  magnitude  and  frequency  of  the 
disturbance  [lOj.  and  of  the  effect  of  noise  on  the 
measurements  f!2:. 


Fieure  12:  Maenitude  Estimate 
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The  scheme  was  implemented  on  an  exper:- 
Fieure  13:  Frequency  Estimate  mental  active  noise  control  system  developed  at 

the  University  of  Utah.  The  algorithm  was  coded 
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in  assembly  language  on  a  Motorola  DSP96002 
32-bit  floating-point  digital  signal  processor.  The 
sampling  rate  was  set  at  3  kHz.  A  singie  book¬ 
shelf  speaker  with  a  4-inch  low-frequency  driver, 
located  approximately  2  ft  away  from  the  error 
microphone,  generated  a  periodic  signal  consti¬ 
tuting  the  noise  source.  The  microphone  sig¬ 
nal  was  passed  through  an  anti-aliasing  niter  and 
sampled  by  a  seif-calibrating  16- bit  analog- to- 
digital  converter  before  being  sent  to  the  DSP 
system.  The  noise  cancellation  signal  was  sent  to 
a  second  speaker  placed  approximately  1  ft  away 
from  the  microphone.  Only  the  error  sensing  mi¬ 
crophone  signal  was  provided  to  the  algorithm  for 
the  controller  calculations. 
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Figure  15:  Direct  Scheme  for  Two  Sinusoids 

The  results  of  an  experiment  are  shown  on 
Fig.  14.  The  signal  at  the  microphone  is  plot¬ 
ted  in  dB  as  a  function  of  time.  The  aigorithm 
is  not  used  until  0.5  sec.  in  the  experiment,  to 
show  the  amount  of  noise  before  compensation. 
The  plot  shows  that  the  aigorithm.  once  engaged, 
cancels  the  noise  rapidly.  Experiments  were  also 
performed  using  an  algorithm  designed  for  multi¬ 
ple  harmonic  components.  The  scheme  is  shown 
in  Fig-  15  for  the  case  of  a  fundamental  and  a 
third  harmonic.  The  feedback  compensation  in 
the  matrices  C\{s)  and  C3(s)  is  similar  to  that 
used  for  a  singie  component  (including  the 
matrix  and  the  linear  filters,).  A  specific  feature 
of  the  scheme  is  that  the  estimated  frequencies  of 
the  two  components  of  the  control  signal  are  tied 


together  by  a  factor  of  3,  rather  than  being  al¬ 
lowed  to  converge  independently.  Details  of  this 
scheme,  and  experimental  results,  are  available  in 
[13]. 


5.  Chaplin  and  Smith’s  Patent 
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Figure  16:  Chaplin  and  Smith  s  Scheme 

Another  scheme  for  periodic  disturbance  cancel¬ 
lation  was  proposed  in  the  patent  literature  by 
Chaplin  &  Smith  [14].  Fig.  16  shows  a  picture 
of  the  scheme.  The  right  side  of  the  figure  shows 
the  portion  of  the  aigorithm  that  determines  the 
magnitude  of  the  disturoance.  while  the  left  side 
is  related  to  the  determination  of  the  frequency 
and  phase  of  the  disturbance.  Although  the  fre¬ 
quency  estimate  is  obtained  in  a  similar  way  as  in 
the  modified  indirect  scheme,  we  view  this  con¬ 
cept  as  closer  to  the  direct  approach,  because  fre¬ 
quency  and  phase  estimation  are  combined  to¬ 
gether. 

The  patent  is  not  explicit  regarding  many 
important  details,  so  that  significant  difficulties 
must  be  overcome  to  implement  the  concept  and 
a  large  number  of  schemes  could  be  obtained.  A 
specific  difficulty  towards  implementing  the  con¬ 
cept  is  that  it  requires  a  phase  comparator  whose 
output  is  zero  when  the  two  input  signals  are  in 
phase.  Typical  phase  comparators  produce  zero 
outputs  for  signals  that  are  in  quadrature.  The 
lack  of  guidelines  for  the  selection  of  the  gains 
and  of  the  filter  parameters  also  have  the  result 
that  naive  attempts  at  implementing  the  scheme 
easily  produce  unstable  ciosed-loop  systems. 

Some  answers  to  these  questions  were  provided 


1285 


Proceedings  ofISMA23.  1998  -  volume  3 


Figure  17:  Modified  Chaplin  k  Smith  Scheme 

in  [15],  and  a  practical  scheme  is  shown  in  Fig.  17. 
An  undesirable  tendency  for  convergence  of  the 
original  scheme  towards  a  condition  with  Q\  »  0 
was  identified  and  resolved  by  picking  some  of  the 
signals  at  the  input  of  the  plant,  rather  than  at 
the  output.  A  simple  multiplier  was  implemented 
for  the  phase  comparator,  because  a  quadrature 
signal  uq  was  used  instead  of  u.  The  low-pass 
filter  was  designed  as  a  lead /lag  filter  with  inte¬ 
gral  action,  as  for  the  direct  scheme  considered 
earlier.  An  analysis  similar  to  the  one  used  lor 
that  scheme  yielded  a  successful  design  for  the 
adaptive  algorithm.  After  numerous  adjustments 
made  to  the  original  concept,  the  performance  01 
the  scheme  was  found  to  be  comparable  to  that 
of  the  direct  scheme. 


Tim*  (MO) 


Figure  18:  Frequency  Estimate  for  the  Modified 
Chaplin  k  Smith  Scheme 

Despite  the  similarities,  however,  there  ex¬ 


ists  an  interesting  difference  between  the  direct 
scheme  and  the  modified  scheme  based  on  Chap¬ 
lin  k  Smith’s  patent.  Specifically,  the  signal 
X2  converges  to  zero  under  ideal  conditions  in 
Fig.  10,  because  the  output  y  converges  to  zero. 
On  the  other  hand,  the  signal  x7  of  Fig.  17  does 
not  converge  to  zero,  because  the  scheme  uses  a 
signal  that  is  similar  to  the  one  used  for  the  modi¬ 
fied  indirect  scheme  (interestingly,  the  use  of  such 
a  signal  is  necessary  for  the  indirect  approach, 
but  not  for  the  direct  approach).  As  a  result,  the 
frequency  estimate  62  for  the  modified  Chaplin 
k  Smith  scheme  exhibits  persistent  fluctuations, 
shown  in  Fig.  18,  These  fluctuations  do  not  nec¬ 
essarily  lead  to  poor  performance,  and  may  be  re¬ 
duced  by- filtering.  However,  they  are  not  present 
for  the  parameter  of  the  direct  scheme,  shown  in 
Fig.  13. 

6.  Conclusions 

Three  approaches  were  discussed  for  the  feedback 
control  of  narrowband  disturbances  of  unknown 
frequency.  The  indirect  approach  and  the  direct 
approach  were  found  to  be  the  most  suitable  for 
active  noise  control  problems.  The  indirect  ap¬ 
proach  was  more  flexible,  but  a  more  complete 
analysis  was  available  for  the  direct  approach. 
The  algorithms  based  on  the  adaptive  implemen¬ 
tation  of  the  internal  model  principle  did  not 
seem  well-suited  to  active  noise  control  problems 
in  their  current  form.  The  scheme  based  on  Chap¬ 
lin  k  Smith  patent  was  found  to  work  well,  pro¬ 
vided  that  a  significant  number  of  adjustments 
were  made  to  the  original  concept.  The  scheme 
could  be  viewed  as  a  special  case  of  the  direct 
approach. 

The  paper  emphasized  the  design  of  single¬ 
channel  algorithms  for  pure  sinusoidal  distur¬ 
bances.  The  extension  of  the  schemes  to  mul¬ 
tiple  harmonic  components  is  relatively  straight¬ 
forward,  although  pratical  design  may  be  harder. 
The  extension  to  multi-channel  systems  is  possi¬ 
ble,  but  complex  and  an  area  of  current  research. 
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Abstract:  This-  paper  proposes  an  active  noise  con¬ 
trol  algorithm  for  periodic  disturbances  of  unknown  fre¬ 
quency.  The  algorithm  is  appropriate  for  the  feedback 
case  in  which  a  single  error  microphone  is  used.  A 
previously-proposed  algorithm  for  the  rejection  of  sinu¬ 
soidal  noise  sources  is  extended  for  the  cancellation  of 
multiple  harmonics.  Unlike  many  other  approaches,  the 
estimates  of  the  frequencies  of  the  separate  harmonics 
are  tied  together  within  the  algorithm  to  account  for  the 
integer  multiplicative  relations  between  them.  The  dy¬ 
namic  behavior  of  the  closed-loop  system  is  analyzed  us¬ 
ing  an  approximation  that  is  shown,  in  simulations,  to 
provide  an  accurate  representation  of  the  system’s  be¬ 
havior.  Experimental  results  on  an  active  noise  control 
testbed  demonstrate  the  success  of  the  method  in  a  prac¬ 
tical  environment. 

1.  Introduction 

The  problem  of  active  noise  control  is  considered,  as 
shown  in  Fig.  1.  A  microphone  is  used  to  measure  the 
instantaneous  noise  level  at  some  location  to  be  made 
quiet.  The  signal  is  sampled  and  then  processed  by  a 
digital  signal  processing  system,  and  an  anti-noise  field 
is  generated  through  a  loudspeaker.  The  objective  is  to 
eliminate  or  significantly  reduce  the  noise  level  at  the  mi¬ 
crophone  through  destructive  interference. 


Figure  1:  Active  noise  control  (feedback  scheme) 

As  shown  in  Fig.  1,  the  system  configuration  under 
consideration  uses  only  one  microphone.  In  other  words, 
the  situation  is  of  a  pure  feedback  nature,  in  contrast  to 
the  feedforward  set-up  that  is  often  considered  in  such 
applications  [1],  Moreover,  the  noise  is  assumed  to  be  pe¬ 
riodic  in  nature  so  that,  from  a  control  perspective,  the 
problem  is  a  classical  rejection  problem  for  periodic  dis¬ 
turbances,  except  that  the  frequency  of  the  disturbance  is 
unknown  and  potentially  time- varying.  A  limited  number 
of  approaches  exist  to  address  this  problem.  They  include 
adaptive  algorithms  employing  the  internal  model  prin¬ 
ciple  [2,  3,  4]  and  extensions  of  adaptive  algorithms  for 
disturbances  of  known  frequency  [5,  6]. 

•This  material  is  based  upon  work  supported  by  the  U.S.  Army 
Research  Office  under  grant  number  D  A  AH04-96- 1-0085.  The  con¬ 
tent  of  the  paper  does  not  necessarily  reflect  the  position  or  the  pol¬ 
icy  of  the  federal  government,  and  no  official  endorsement  should 
be  inferred. 


This  paper  extends  the  algorithm  of  [6]  to  the  more  gen¬ 
eral  case  of  periodic  disturbances  with  multiple  harmon¬ 
ics.  A  particular  feature  of  the  new  algorithm  is  its  use 
of  the  integer  relationships  between  the  harmonic  compo¬ 
nents  of  the  disturbance  within  the  adaptive  algorithm. 

2.  Adaptive  Algorithm 

2.1  Problem  Statement 

Assume  that  the  transformation  from  the  speaker  to  the 
microphone  is  a  stable  linear  time-invariant  system  with 
transfer  function  P(s)  and  that  the  effect  of  the  noise 
source  is  additive.  In  the  Laplace  domain,  the  system 
can  be  modelled  as 

2/0)  =  P(s)(u(s)  -  d(s)),  (1) 

where  y(s)}  u{s )  and  d(s)  are  the  Laplace  transforms  of 
the  microphone  signal,  of  the  speaker  output,  and  of  the 
equivalent  noise  signal  at  the  speaker  location,  respec¬ 
tively.  Alternatively,  u(t)  may  be  viewed  as  the  control 
input,  d(t)  as  the  disturbance,  and  y(t)  as  the  plant  out¬ 
put.  The  goal  of  the  control  system  is  to  generate  u(t) 
such  that  y(t)  —  0  as  t  —  oo.  The  objective  would  be 
achieved  if  u(t)  =  d(t),  but  the  disturbance  d(t)  is  not 
known  or  measured  in  any  way  except  through  its  effect 
at  the  output  of  the  system.  It  is  assumed  to  be  a  periodic 
signal,  so  that 

n 

d(t)  =  Yldk  cos(afc,  i0))> 

*=1 

<*m0)  =  kuji-  (2) 

The  parameters  cj15  and  ajfc}<*(0)  (for  k  =  1,  ...,ra)  are 
unknown.  The  order  of  the  highest  harmonic,  n,  is  as¬ 
sumed  to  be  finite  and  known.  Certain  harmonics  may 
also  be  specified  to  be  absent,  i.e.,  certain  values  of  d*. 
may  be  known  to  be  small  a  priori .  For  simplicity  of 
presentation,  we  will  consider  the  case  where  the  funda¬ 
mental  and  the  third  harmonic  are  present  (only  d\  and 
d3  are  nonzero). 

2.2  Adaptive  Algorithm 

The  structure  of  the  proposed  scheme  is  shown  in  Fig.  2. 
The  signal  u\  nominally  cancels  the  fundamental  (at  fre¬ 
quency  wi),  while  the  signal  u3  cancels  the  third  har¬ 
monic.  The  parameters  and  c*3  are  the  estimates  of 
the  angles  of  the  two  components  of  the  disturbance.  The 
parameters  9n  and  03i  are  the  estimates  of  the  magni¬ 
tudes  of  the  two  sinusoids,  and  0io  is  the  estimate  of  the 
frequency  of  the  fundamental.  The  value  of  9\2  is  inte¬ 
grated  to  obtain  the  angle  aq.  For  the  third  harmonic, 
$32  is  not  the  frequency  but  rather  is  the  relative  phase  of 
the  signal.  The  algorithm  uses  the  assumption  that  the 
second  sinusoid  is  a  third  harmonic  of  the  fundamental 
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by  letting  the  angle  a3  be  equal  to  the  sum  of  three  times 
the  angle  of  the  fundamental  and  of  the  relative  phase 

#32- 

The  equations  for  the  control  algorithm  are  thus 


u  —  flu  cos(ai)  +  03i  cos(a3) 

Oil  =  012j  Ois  =  3  •  Oil  +  032 

2/ii  =  ycos(ai),  3/12  =  —  ysin(of!) 

2/31  =  y  cos(a3),  2/32  =  -</sin(a3).  (3) 

The  parameters  have  nominal  values  d\x  —  d\ ,  0*2  =  u>i, 
^31  =  d3,  and  0J2  =  a3ld(0)  —  3ai^(0).  For  these  values, 
and  for  c*i(t)  —  uji t  =  ai,d(0),  the  output  converges  to 
zero. 

The  transfer  function  matrix  Ci(s)  relates  the  signals 
2/11  and  yi2  to  the  parameters  On  and  0i2 ,  respectively. 
Similarly,  the  transfer  function  matrix  C${s)  relates  the 
signals  y3i  and  2/32  to  the  parameters  03 1  and  032.  The 
matrices  Ci(s)  and  63(5)  are  the  products  of  constant 
matrices  with  diagonal  transfer  function  matrices.  They 
are  defined  els  follows.  Consider  the  real  and  imaginary 
parts  of  the  plant  frequency  response  at  the  two  frequen¬ 
cies  of  interest,  given  by 


pR,  1  =  Re[P{juji)  ],  Pb,3  =  Re[P(Zjui)]t 
Pi,  1  =  MP(M)],  pitz^Im[P(Zjwl)]t 
and  define  the  matrices 


Gi  = 


( 


Pr,  1 

Pi,  1 


Variables  in,  X12,  a?3i,  and  x32  are  defined  as 


and  the  algorithm  parameters  are  given  by 

0U  =  —  2<7i2?u,  0i2  =  -2g2Xi2f/die, 

031  =  -2^3X31,  032  =  -2y3ar32/d3e. 


(4) 

(5) 

(6) 

(7) 


The  update  laws  are  defined  through  integral  relation¬ 
ships  to  guarantee  zero  steady-state  errors.  The  control 
law  for  0i2  is  slightly  different  from  the  others,  with  the 
signal  £12  filtered  so  that 

*«/(«)  =  fto*  12(f),  FW  =  txT •  (8) 

The  compensation  filter  is  necessary  to  ensure  the  sta¬ 
bility  of  the  closed- loop  system.  The  constants  a,  b,  <71, 
<72,  and  <73  will  be  adjusted  to  obtain  satisfactory  perfor¬ 
mance.  The  parameters  d\e  and  d3e  are  estimates  of  d\ 
and  d3  (see  section  3.2). 

To  extend  the  algorithm  for  arbitrary  harmonics,  ad¬ 
ditional  paths  similar  to  that  for  the  third  harmonic  in 
Fig.  2  may  be  added.  The  multiplying  factor  of  3,  the  ma¬ 
trix  G3,  and  the  estimate  d3e  are  the  only  elements  that 
need  to  be  changed.  Note  that,  in  the  proposed  imple¬ 
mentation,  frequency  estimation  is  provided  through  the 
first  harmonic.  This  choice  is  not  essential,  and  frequency 
estimation  based  on  another  harmonic  is  possible. 

3.  Stability  Analysis  and  Control  Design 

3.1  Stability  Analysis 

Our  analysis  of  the  system  is  based  on  a  fundamental 
fact,  whose  proof  is  reminiscent  of  derivations  found  in 
the  study  of  frequency-modulation  communication  sys¬ 
tems  [7]  and  of  averaging  methods  applied  to  adaptive 
systems  [8].  The  following  conditions  are  assumed: 

•  the  values  of  0U}  012,  03i,  and  032  vary  sufficiently 
slowly  that  the  response  of  the  plant  to  the  signal 
u(t)  may  be  approximated  by  the  steady-state  out¬ 
put  of  the  plant  for  the  two  sinusoidal  signals  with 
frequencies  0i2  and  30i2. 

•  the  instantaneous  frequency  0i2  is  close  to  ui ,  so  that 
P(j0 2)  may  be  replaced  by  P(juj  1)  and  P(3j02)  may 
be  replaced  by  P(3ju>i). 

Basic  Fact:  Considering  low-frequency  components 
only,  the  signals  xn(f),  x  12(f),  x 31(f),  and  a?32(t)  are  ap¬ 
proximately  given  by 

(  x;iC0  A  _  i  /  Quit)  -  0*1  cos(oj(<)  -  a, •,<*(*))  \  ,  . 

V  ^(t)  J  2  V  0*i  sin(at(i)  -  aiid(t))  )  > 

for  i  =  {1,3},  with 


/  (0i2(^)  -  Bidder  +  ai(0)  —  ai,d(0), 

Jo 

«3(0  -  =  3 (ax(t)  -  al}d(f))  +  M*)  -  032-  (10) 


The  proof  follows  similar  steps  as  in  the  proof  in  [6]  and 
is  omitted.  The  elimination  of  the  high-frequency  compo¬ 
nents  within  the  system  can  be  achieved  through  low-pass 
filtering  of  the  signals.  However,  the  signals  are  filtered 
within  the  compensators  Ci(s)  and  C3(s),  and  although 
the  filtering  is  not  ideal,  simulations  show  that  it  is  suffi¬ 
cient  for  the  satisfactory  operation  of  the  system. 

3.2  Compensator  Design 

Although  the  equations  are  nonlinear,  a  linear  system 
is  obtained  if  the  parameters  are  close  to  their  nominal 


values  and  the  phase  error  Sai(t)  =  ax(t)  —  is 

small.  The  linearized  system  is 


f  *u(*) 

V  x^(t) 

f  x3l(*) 

V  ^32(0 


1  (  M*)-*U  ^ 

2  \  e*n )' 

1  (  hi  (<)  -  *31 

2  ^  ^(3^(0  +  082(0 -^3) 


(11) 


The  linearized  dynamics  from  the  parameters  0XX  and  #12 
to  the  variables  xn  and  arX2  are  decoupled  from  one  an¬ 
other  and  are  not  dependent  on  the  dynamics  of  the  vari¬ 
ables  associated  with  the  third  harmonic.  In  closed-loop, 
the  dynamics  of  <9XX  are  those  of  a  first-order  system  with 
a  pole  at  s  =  — £X.  For  #12,  the  closed-loop  poles  are 
determined  by  the  roots  of  s2(s  +  b)  4-  <72(5  +  a)  =  0,  if 
die  =  di  =  0fx.  Otherwise,  <72  is  replaced  by  gzdx/die. 
Stability  is  guaranteed  if  32  >  0  and  b  >  a  >  0.  For  the 
variables  associated  to  the  third  harmonic,  the  closed- 
loop  dynamics  are  those  of  a  first-order  system  with  a 
pole  at  s  =  —<73.  For  #32,  the  pole  is  at  s  =  —gzdz/dze  if 
dze  is  not  equal  to  *  =  0Siv  The  phase  error  5ax(t)  also 
appears  as  a  disturbance  on  the  equation  for  $32 .  The  sta¬ 
bility  of  the  equation  for  #12  ensures  that  this  disturbance 
vanishes  with  time. 

Because  the  magnitudes  of  the  sinusoidal  components 
di  and  dz  act  as  gains  in  the  two  transfer  functions  associ¬ 
ated  with  phase  locking,  estimates  of  the  parameters  are 
used  to  ensure  that  the  closed-loop  poles  are  set  at  desir¬ 
able  values.  However,  the  stability  of  the  linear  systems 
is  not  dependent  upon  the  accuracy  of  these  estimates. 
The  algorithm  also  requires  the  knowledge  of  the  matri¬ 
ces  G 1  and  G3,  which  depend  on  wx.  One  may  choose 
to  set  these  matrices  for  a  value  of  the  frequency  in  the 
middle  of  the  expected  range  of  operation,  or  one  may 
use  the  estimated  frequency  $12  in  real-time.  Either  way, 
knowledge  of  the  frequency  response  of  the  plant  in  the 
frequency  range  of  interest  is  required. 


4.  Simulation  Results 


Time  (seconds) 

Figure  3:  Plant  output  ( y ) 

The  performance  of  the  algorithm  is  examined  via  simu¬ 
lation.  We  consider  a  situation  in  which  P(s )  =  100/(s  + 
100),  u)\  —  100,  d\  —  1,  and  dz  =  —1.  The  parameters 


Figure  4:  Magnitude  of  the  fundamental  (0XX) 


Time  (seconds) 

Figure  5:  Frequency  of  the  fundamental  (0X2) 


<71  and  gz  are  set  to  10,  leading  to  closed-loop  poles  for 
the  first-order  systems  at  -10  rad/s.  The  other  parame¬ 
ters  are  set  to  gz  =  400,  a  =  5,  and  b  =  30,  leading  to 
closed-loop  poles  for  the  frequency  control  loop  located  at 
—  10  rad/s  and  — 10  ±  j  10  rad/s.  The  initial  states  of  the 
parameters  are  zero,  except  for  #xx(0)  =  0.9,  012(O)  =  90 
rad/s. 

Fig.  3  shows  the  output  of  the  plant,  which  is  found  to 
decrease  to  negligible  values  in  less  than  a  second.  The 
transient  behavior  of  the  magnitude  estimate  0X1  is  shown 
in  Fig.  4,  where  the  solid  line  is  the  parameter  response, 
and  the  dashed  line  is  the  response  predicted  from  a  sim¬ 
ulation  of  an  approximate  system.  The  approximate  sys¬ 
tem  is  composed  of  the  control  law  (7),  (8),  and  the  non¬ 
linear  approximation  (9),  (10).  The  frequency  estimate 
#12  is  shown  in  Fig.  5.  The  matches  between  the  actual 
and  approximate  behaviors  is  good,  and  the  degree  of 
match  is  similar  to  those  for  other  adaptive  systems  [8]. 

The  magnitude  estimate  for  the  third  harmonic  #31  is 
shown  in  Fig.  6  and  the  phase  estimate  #32  in  Fig.  7. 
Note  that  the  magnitude  9^  was  set  to  -1,  and  the  esti¬ 
mate  of  the  magnitude  converged  to  1,  with  the  estimate 
of  the  phase  converging  to  -7 r,  or  -180°.  Again,  the 
approximations  are  very  good,  and  although  the  nonlin- 


Figure  10:  Frequency  of  the  fundamental  (0i2) 


Figure  11:  Magnitude  of  the  third  harmonic  (#31) 


estimate  612).  The  units  of  the  frequency  estimate  are 
given  in  radians/sample;  i.e,  2 tt  ■  110/8000  =  0.086.  The 
initial  frequency  estimate  corresponded  to  115  Hz.  Other 
parameters  were  initially  set  to  zero.  Shown  in  Fig.  11 
and  12  are  the  parameters  related  to  the  third  harmonic 
(magnitude  estimate  031  and  phase  estimate  032  (in  rad)). 
It  was  found  that  the  frequency  of  the  disturbance  could 
vary  over  a  wide  range,  once  the  algorithm  had  locked 
onto  the  disturbance  frequency.  Techniques  from  phase- 
locked  loops  could  be  used  to  expand  the  lock-in  range 
[7]  but  were  not  implemented.  Other  experiments  em¬ 
ploying  several  harmonics  as  well  as  frequency  estimation 
using  high-order  harmonics  provided  results  comparable 
to  those  shown. 

6.  Conclusions 

An  adaptive  algorithm  is  proposed  for  the  rejection  of 
periodic  disturbances  of  unknown  frequency.  For  sim¬ 
plicity,  the  algorithm  is  described  for  a  noise  consisting 
of  a  fundamental  component  and  a  third  harmonic,  al¬ 
though  the  method  is  easily  extended  to  noises  with  an 
arbitrary  number  of  harmonics.  As  in  other  solutions  to 
this  control  problem,  the  closed-loop  system  is  a  complex 


nonlinear  time- varying  system.  However,  we  showed  that 
an  approximate  nonlinear  time- invariant  system  provided 
a  very  accurate  representation  of  the  dynamic  behavior 
of  the  system.  A  further  approximation  of  the  system 
through  linearization  was  useful  for  the  selection  of  the 
design  parameters.  The  algorithm  was  tested  experimen¬ 
tally  on  an  active  noise  control  system  at  the  University 
of  Utah  to  demonstrate  the  success  of  the  method  in  a 
practical  environment. 
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ear  effects  are  significant,  the  design  based  on  the  linear 
approximation  is  adequate  to  obtain  convergence  of  the 
system. 
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Figure  6:  Magnitude  of  the  third  harmonic 


5.  Experimental  Results 

The  scheme  was  implemented  on  an  experimental  ac¬ 
tive  noise  control  system  developed  at  the  University  of 
Utah.  The  algorithm  was  coded  in  assembly  language  on 
a  Motorola  DSP96002  32-bit  floating-point  digital  signal 
processor,  The  sampling  rate  was  set  at  8  kHz.  A  sin¬ 
gle  bookshelf  speaker  with  a  4-inch  low-frequency  driver, 
located  approximately  2  ft  away  from  the  error  micro¬ 
phone,  generated  a  periodic  signal  constituting  the  noise 
source.  The  microphone  signal  was  passed  through  an 
anti-aliasing  filter  and  sampled  by  a  self-calibrating  16- 
bit  analog-to-digital  converter  before  being  sent  to  the 
DSP  system.  The  controller  output  signal  was  sent  to  a 
noise  cancelling  speaker  placed  approximately  1  ft  away 
from  the  microphone.  Only  a  single  error  sensing  micro¬ 
phone  signal  was  used. 

The  frequency  response  of  the  plant  was  determined 
during  a  rapid  calibration  phase  in  which  pure  sinusoidal 
tones  were  applied  to  the  noise  cancellation  speaker,  and 
the  responses  were  measured  by  the  microphone  signal. 
The  real  and  imaginary  parts  of  the  frequency  response 
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Figure  8:  Microphone  signal 


Figure  9:  Magnitude  of  the  fundamental  (#n) 


were  obtained  at  16  different  frequencies,  spaced  logarith¬ 
mically  between  32.5  Hz  and  1  kHz.  In  other  experiments, 
the  frequency  response  was  calculated  from  a  50-tap  finite 
impulse  response  model  obtained  with  an  adaptive  iden¬ 
tification  algorithm  and  a  white  noise  input.  This  identi¬ 
fication  procedure  took  longer.  The  matrices  G\  and  G3 
were  adjusted  in  real-time,  based  on  the  frequency  esti¬ 
mate  $i2 .  Values  from  a  look-up  table  were  interpolated 
linearly  as  needed.  Update  of  the  matrices  was  performed 
every  8  samples.  Because  of  the  digital  implementation, 
a  discrete-time  equivalent  of  the  algorithm  was  imple¬ 
mented,  with  the  2-domain  poles  placed  in  the  vicinity 
of  z  —  0.995  for  the  parameters  of  the  fundamental  and 
2  =  0.99  for  the  parameters  of  the  third  harmonic. 

The  results  of  one  experiment  are  shown  on  Fig.  8,  in 
which  the  signal  at  the  error  microphone  is  plotted  as  a 
function  of  time.  The  algorithm  is  not  engaged  until  0.5 
sec.  in  the  experiment,  so  that  the  amount  of  noise  before 
compensation  can  be  judged.  The  frequency  of  the  funda¬ 
mental  is  110  Hz.  The  plot  shows  that  the  algorithm,  once 
engaged,  cancels  the  noise  within  a  fraction  of  a  second. 
The  adaptive  parameters  for  the  fundamental  are  shown 
in  Fig.  9  (magnitude  estimate  0n)  and  Fig.  10  (frequency 
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A  Discussion  of  Chaplin  and  Smith’s  Patent 
for  the  Cancellation  of  Repetitive  Vibrations 


Marc  Bodson 


Abstract — This  paper  considers  a  method  proposed  by  Chaplin  and 
Smith  for  the  cancellation  of  repetitive  vibrations.  Direct  implementation 
of  the  concepts  of  the  patent  is  not  straightforward  because  of  the  lack 
of  precise  information  regarding  certain  components,  and  because  of  the 
absence  of  guidelines  for  the  design  of  a  system  with  satisfactory  stability 
and  performance  properties.  This  paper  proposes  a  specific  algorithm 
based  on  the  concepts  of  the  patent,  and  provides  an  approximate  analysis 
which  is  found  useful  to  obtain  a  closed-loop  system  with  predictable 
dynamic  characteristics.  Simulations  demonstrate  the  validity  of  the 
approximation  and  the  success  of  the  design.  A  tendency  of  the  algorithm 
for  convergence  toward  undesirable  operating  states  is  identified,  and  an 
improved  version  is  derived.  The  algorithm  is  also  compared  to  another 
algorithm  proposed  for  the  same  purposes. 

Index  Terms — Active  noise  control,  active  vibration  control,  adaptive 
control,  disturbance  rejection. 


I.  Introduction 

The  active  control  of  noise  and  vibration  is  useful  as  an  alternative 
to  expensive  passive  damping  methods.  In  many  applications,  the 
algorithms  are  what  are  called  adaptive  feedforward  control  algo¬ 
rithms.  A  measurement  is  taken  from  the  source  of  the  disturbance: 
for  example,  a  microphone  or  accelerometer  placed  on  or  close  to 
the  source.  The  control  algorithm  is  then  inherently  of  a  feedforward 
nature,  although  feedback  is  used  for  adaptation.  When  feedforward 
measurements  are  not  available,  one  must  rely  on  feedback  algorithms 
to  provide  for  compensation.  Such  algorithms  are  usually  more 
difficult  to  design.  Among  the  problems  for  which  adaptive  feedback 
compensation  may  be  considered  are  those  where  the  disturbance 
signal  is  periodic.  This  case  occurs  when  the  source  of  the  disturbance 
is  a  rotating  machine.  The  disturbance  rejection  problem  for  periodic 
disturbances  of  unknown  frequency,  using  feedback  information  only, 
is  called  the  narrow-band  adaptive  feedback  case  [1].  For  simplicity, 
we  will  assume  that  the  disturbance  has  a  single  harmonic  component, 
i.e.,  that  it  is  sinusoidal.  More  complex  algorithms  can  be  built  to 
cancel  multiple  harmonics  using  the  approaches  developed  for  a 
single  component. 

Few  algorithms  are  specifically  targeted  to  the  narrow-band  adap¬ 
tive  feedback  case.  An  approach  is  based  on  the  adaptive  im¬ 
plementation  of  the  internal  mode!  principle  [2],  [3].  These  al¬ 
gorithms  have  the  advantage  of  providing  adaptation  to  unknown 
plant  parameters,  as  well  as  to  unknown  disturbance  parameters. 
However,  they  have  delicate  stability  properties,  and  are  not  well 
suited  to  active  noise  and  vibration  control  problems  [4].  Another 
approach  consists  of  extending  the  capabilities  of  existing  adaptive 
algorithms.  An  algorithm,  proposed  in  [5],  combines  frequency 
estimation  with  an  adaptive  algorithm  for  the  rejection  of  disturbances 
with  known  frequency.  Another  algorithm  combines  the  estimation 
of  the  magnitude,  frequency,  and  phase  in  a  single  control  loop. 
Chaplin  and  Smith  propose  their  own  method  in  [6].  While  many 
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Fig.  1.  Chaplin  and  Smith's  method  for  canceling  repetitive  vibrations. 

details  are  missing  that  are  needed  for  the  implementation  of  the 
concepts,  we  propose  our  own  interpretations  and  extensions  of 
the  original  concepts  to  obtain  an  algorithm  that  is  shown,  in 
simulations,  to  achieve  the  desired  results.  To  make  the  design 
possible,  an  approximate  analysis  method  is  presented  that  allows  one 
to  accurately  predict  the  dynamic  characteristics  of  the  closed-loop 
system.  Interestingly,  the  analysis  method  is  the  same  as  was  used 
in  [5],  and  is  similar  to  the  averaging  methods  applied  to  adaptive 
systems  in  [7],  and  to  the  approximations  made  in  the  analysis  of 
phase-locked  loops  [8]. 


II.  Chaplin  and  Smith's  Method 

Chaplin  and  Smith  begin  the  discussion  of  their  patent  [6]  by 
presenting  a  scheme  for  the  cancellation  of  periodic  vibrations  relying 
on  measurements  taken  from  the  machine  that  is  the  source  of  the 
vibration.  Then,  an  approach  is  proposed  to  remove  the  requirement  of 
the  measurement,  and  several  feedback  schemes  are  proposed,  with 
each  scheme  building  on  the  previous  one.  The  descriptions  leave 
many  details  unspecified,  so  that  a  wide  variety  of  algorithms  could 
be  obtained  through  application  of  the  concepts  of  the  patent.  Our 
study  applies  to  the  last  scheme,  which  is  the  most  specific. 

Fig.  I  shows  the  scheme  under  consideration.  It  is  essentially 
[6.  Fig.  5],  The  only  differences  are  that  the  plant  has  been  identified 
on  the  figure,  and  the  signals  have  been  labeled  for  the  purpose  of 
the  discussion.  The  plant  has  control  input  it  and  output  y.  It  is 
perturbed  by  a  disturbance  <1.  The  effects  of  a  and  <1  are  assumed  to 
be  additive,  so  that  the  disturbance  may  be  cancelled  by  the  control 
signal.  The  disturbance  is  assumed  to  be  a  sinusoidal  signal  with 
unknown  magnitude,  frequency,  and  phase.  An  actuator  is  shown, 
whose  output  is  a  sinusoidal  signal  with  magnitude  and  frequency 
specified  by  the  inputs  i  and  M-±,  respectively. 

In  the  scheme,  the  frequency  of  the  disturbance  is  estimated  using  a 
phase-locked  loop.  As  pointed  out  by  Chaplin  and  Smith,  a  difficulty 
could  arise  if  the  output  of  the  plant  y  were  used  for  frequency 
estimation.  The  reason  is  that  the  cancellation  scheme  is  designed  to 
eliminate  the  signal  y  on  which  frequency  estimation  would  be  based. 
To  avoid  the  problem,  an  estimated  output  </*  is  reconstructed  using 
a  so-called  processing  unit .  The  signal  y>  is  then  subtracted  from  the 
output  y  to  produce  an  error  signal  e  which,  in  theory,  is  equal  to  the 
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component  of  the  output  due  to  the  disturbance  (i.e.,  the  output  that 
would  be  observed  if  the  control  input  were  zero). 

A  phase  comparator  produces  a  signal  w 2  proportional  to  the  phase 
error  between  ye  and  e,  in  a  configuration  that  is  typical  of  phase- 
locked  loops.  Note  that  the  difference  in  phase  between  ye  and  e  is 
equal,  in  theory,  to  the  difference  of  the  phase  between  the  signal 
u  and  its  desired  value.  Therefore,  the  phase  error  signal  W2  may 
be  used  to  adjust  the  frequency  #2  and,  indirectly,  the  phase  of  the 
actuator  signal.  A  low-pass  filter  is  inserted  to  eliminate  the  high 
frequencies  typically  associated  with  phase  comparators. 

The  magnitude  of  the  control  signal  is  adjusted  using  a  feedback 
loop  appearing  on  the  right  of  Fig.  1.  The  plant  output  y  and  the 
estimated  plant  output  yn  are  multiplied,  and  the  resulting  signal  tv i 
is  filtered  by  an  integrator  to  produce  the  magnitude  signal  for  the 
actuator.  The  idea  is  that,  if  the  phase  of  the  control  signal  is  correct, 
the  product  y  •  ye  is  positive  on  the  average  if  Q\  is  less  than  its 
desired  value,  and  negative  otherwise. 

Note  that  the  patent  proposes  the  scheme  of  Fig.  1  for  specific 
application  to  vibration  control,  and  for  the  case  where  a  special 
actuator  is  used  to  generate  a  sinusoidal  force.  The  magnitude  and 
frequency  of  the  sinusoidal  excitation  are  the  input  signals  of  the 
actuator.  However,  the  scheme  may  be  applied  to  a  broad  range  of 
problems  where  periodic  disturbances  of  unknown  frequency  must 
be  rejected.  To  use  an  arbitrary  actuator,  it  is  only  necessary  to 
generate,  in  analog  or  digital  form,  a  sinusoidal  wave  with  prescribed 
magnitude  and  frequency. 

On  the  other  hand,  there  are  two  limitations  to  the  patent.  The 
first  is  that  it  does  not  provide  clear  guidelines  for  a  successful 
implementation.  Experimentation  with  the  scheme  shows  that  it  is 
not  difficult  to  obtain  an  unstable  feedback  system.  Because  the 
closed-loop  system  is  nonlinear  and  time  varying,  analysis  is  not 
straightforward.  Our  analysis,  discussed  later  in  the  paper,  addresses 
this  issue  and,  further,  shows  how  to  select  the  low-pass  filter  to 
ensure  the  stability  of  the  closed-loop  system. 

Another  difficulty  with  the  direct  implementation  of  the  method  is 
that  the  scheme  requires  a  phase  comparator  whose  output  is  zero 
for  zero  phase  error.  Phase  comparators  normally  produce  a  signal 
whose  output  is  zero  when  the  two  input  signals  are  in  quadrature 
(90°  out  of  phase).  The  problem  could  be  resolved  by  shifting  one 
of  the  signals  by  90°.  However,  the  design  of  a  90°  phase  shifter  is 
difficult  in  applications  where  the  frequency  of  the  disturbance  varies 
over  a  wide  range.  We  propose  a  simple  solution  to  this  problem, 
and  derive  a  concrete  algorithm. 

III.  Proposed  Implementation  of  the  Method 

Fig.  2  shows  our  proposed  implementation  of  the  method.  Fig.  1 
has  been  reorganized  in  a  diagram  whose  structure  is  closer  to  that  of 
conventional  control  systems.  The  additive  effect  of  the  disturbance 
is  also  shown  explicitly.  The  plant  is  assumed  to  be  a  linear  time- 
invariant  system  with  transfer  function  P(s).  The  processing  unit  of 
Fig.  I  is  replaced  by  a  transfer  function  P*(.s),  which  is  an  estimate 
of  P(s)-  The  estimate  of  the  magnitude  is  obtained  as  in  the 
original  figure,  except  that  gains  gi  and  a  1  were  introduced  as  design 
parameters.  The  separation  of  the  gain  into  two  gains  gi  and  ui  is 
made  for  convenience,  for  reasons  to  become  clearer  later. 

For  the  estimate  of  the  frequency  02,  a  multiplier  is  used  as  a 
phase  comparator  (it  is  the  simplest  phase  comparator,  and  by  no 
means  the  only  choice  available).  Rather  than  shifting  the  phase  of 
the  signal  ge  by  90° ,  a  quadrature  signal  yq  is  obtained  by  filtering  a 
quadrature  input  signal  aq  by  the  transfer  function  Pc(s).  The  signal 
uq  is  obtained  in  parallel  with  the  signal  a  by  using  a  sine  function 
instead  of  a  cosine  function.  The  filter  F(s)  may  serve  the  purpose 
of  the  low-pass  filter  shown  in  Fig.  1.  However,  we  will  design  it  as 


Fig.  2.  Implementation  of  Chaplin  and  Smith’s  method. 


a  compensation  filter  to  ensure  stability  and  performance.  Two  gains 
go  and  ii>  are  again  inserted  as  design  parameters. 

The  equation  for  the  plant  is,  in  the  Laplace  domain,  y(s)  = 
P( *)(//( *)  -  '/( *)),  where  .(/(*),  «(.s),  and  >I(s)  are  the  Laplace 
transforms  of  the  plant  output,  the  plant  input,  and  the  disturbance 
signal,  respectively.  The  disturbance  tl(t)  is  assumed  to  be  a  sinusoid 
with  fixed  magnitude  and  fixed  frequency  -j1(  so  that 

(lit)  =  0 *  cos (n,,(t)).  n.iit)  =  (1) 

The  parameters  ^1,  and  nrf(0)  are  all  unknown. 

The  equations  for  the  control  algorithm  are 

u[t)  =  6 h(f)  cosfoiO).  n[t)  =  (2) 

while  the  equations  for  the  parameters  H  >  and  other  variables  are 
0i(M  =  -g\<i[iL'\{t).  tio(t)  = 

(t)  =ylt)- y„lt).  «’-(»  =  (y(t)  -  y,  (t))  •  yq(t)  (3) 

uqlt)  =-0|(f)  sitifa (t)). 

The  remaining  variables  are  obtained  through  linear  time -invariant 
filters 

yq{s)  =  PK{s)vq(s) 

wof{s)  =F{s)wo(s)-  (4) 

IV.  Approximate  Analysis 

The  analysis  method  followed  here  was  used  earlier  for  a  closely 
related  scheme  [5].  It  is  similar  to  derivations  found  in  the  analysis  of 
frequency-modulation  communication  systems  [8],  and  to  averaging 
methods  used  for  adaptive  systems  [7].  We  consider  the  following 
assumptions. 

Assumptions: 

1)  The  plant  is  stable,  and  P„(.s)  =  P{s)  (this  equality  is  not 
required  for  the  analysis,  but  is  assumed  for  simplicity). 

2)  The  signals  Oi{t.)  and  0o(t)  vary  sufficiently  slowly  that  the 
response  of  the  plant  to  the  signal  u{t)  can  be  approximated 
by  the  steady-state  output  of  the  plant  for  a  sinusoidal  input 
with  fixed  magnitude  0 1  and  fixed  frequency  O2. 

3)  The  signals  y^t)  and  yq(t)  are  assumed  to  be  approximately 
given  by  the  steady-state  outputs  of  the  transfer  function  P*(s) 
with  inputs  u.  and  uq,  respectively. 
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4)  The  instantaneous  frequency  02  is  close  to  so  that  P{jQ-i) 
can  be  approximated  by 

Next,  denoting  Pr  =  Re[P(J-u*i )],  Pi  —  Im[P(j^i)],  and 
P\i  =  Pfi  +  Pf,  we  obtain  the  following  fact. 

Fact:  Under  the  assumptions,  and  considering  low-frequency 
components  only,  the  two  signals  <c\  (t )  and  tr2(t)  are  approximately 
given  by 


ii'i(t) 


7ft  (nPf.i 


0\{t)  —  0  *  cos{5a{t)) 
0*  sin((sn(f)) 


(5) 


where  ba(t)  =  <\{t)  -  a, /(f). 

Proof:  The  proof  is  omitted  for  brevity. 

Comments:  The  elimination  of  the  high-frequency  components 
can  be  achieved  by  low-pass  filtering  of  the  signals  <rL(f)  and  tr  >{f ), 
as  is  commonly  done  in  phase-locked  loops.  Fig.  2  shows  that, 
in  both  paths,  signals  are  filtered  by  an  integrator.  Although  more 
effective  filters  may  be  used,  their  filtering  benefits  would  have  to  be 
traded  off  with  the  delays  that  would  be  imposed.  We  assume  here 
that  no  additional  filter  is  applied  to  eliminate  the  high-frequency 
components. 


V.  Control  System  Design 

Equation  (5)  can  be  viewed  as  an  alternative  description  of  the 
plant,  with  two  inputs  0|  and  n.  and  two  outputs  and  tr2.  Although 
the  description  is  nonlinear,  a  linearized  system  may  be  obtained  by 
assuming  that  the  magnitude  error  0|  —  0“  and  that  the  phase  error 
<sn  =  t\  -  (\.i  are  small.  Specifically,  the  linearized  system  is 


ii 

:i  — 

«'An 

iVfi'niAt 

(6) 


with  <v\(f)  =  The  linearized  dynamics  of  the  system  from 

the  parameters  0j  and  0l>  to  the  variables  irf  and  >  are  decoupled 
from  one  another,  and  are  those  of  a  simple  gain  of  (1/2)0" P.7/ 
and  of  an  integrator  with  a  gain  ( l/2)(0f  )*Pr/.  respectively.  To 
compensate  for  the  effect  of  the  two  gains,  the  constants  a  \  and 
of  the  control  algorithm  are  chosen  to  be  the  inverses  of  the  two  gains, 
i.e..  a i  =  2/{ti~P-, ).  'i>  =  2/((0f )'" P'fj ).  A  prior  estimate  of  0*  is 
needed  to  set  the  gains,  in  addition  to  an  estimate  of  the  frequency 
response.  The  estimates  do  not  need  to  be  precise,  but  sufficiently 
accurate  for  the  stability  of  the  closed-loop  system  to  be  maintained. 

The  control  loops  for  0|  and  0-j  are  adjusted  to  ensure  stability 
of  the  nominal  system  and  the  rejection  of  the  constant  disturbances 
created  by  the  unknown  parameters.  The  dynamics  of  the  closed- 
loop  system  for  0[  are  those  of  a  first-order  system  with  pole  at 
.s’  =  —  (j\ .  The  parameter  may  be  set  to  place  the  pole  at  a  desirable 
location.  The  closed-loop  system  for  the  second  system  has  dynamics 
determined  by  the  roots  of  s  +  <j->F{ *)  =  0.  Because  of  the  presence 
of  a  constant  disturbance  n ,/{()),  it  is  useful  to  include  integral 
compensation,  i.e.,  to  let  F(s)  have  a  pole  *  =  0.  Such  a  choice 
that  also  guarantees  stability  is  F(s)  =  (*  +  a) /{sis  +  b))  with 
<j->  >  0  and  h  >  n  >  0.  Again,  the  parameters  may  be  chosen  to 
place  the  roots  of  *-(*  4 -b)  +  /;■>(«  +  a)  =  0  at  desirable  locations. 


VI.  Simulation  Results 

We  demonstrate  the  validity  of  the  approach  through  simulations. 
We  let  P(.s-)  =  P,  (.s*)  =  100/(*  +  100),  *'i  =  100,  and  tlx  =  1.  The 
parameter  <]\  is  set  to  10.  leading  to  a  closed-loop  pole  for  the  first 
control  loop  (magnitude  loop)  at  -  10  rad/s.  The  other  parameters  are 
set  to  <j>  =  400,  a  —  o,  and  b  ~  30.  leading  to  closed-loop  poles 
for  the  second  control  loop  (frequency  and  phase  loop)  at  —10  and 
- 10  ±  j  10  rad/s.  The  initial  states  of  all  of  the  parameters  are  zero. 
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Fig.  3.  Responses  of  the  algorithm. 

except  for  0i  (0)  =  0.9,  0^(0)  =  90  rad/s.  and  a(0)  =  90°.  In  other 
words,  the  system  is  initialized  with  a  10%  error  in  magnitude  and 
frequency,  and  a  phase  error  away  from  the  linear  region. 

Fig.  3  shows  the  responses  of  the  system.  From  top  to  bottom,  the 
magnitude  estimate  0 1,  the  frequency  estimate  0j,  and  the  output  of 
the  plant  are  shown.  For  the  estimates,  the  dashed  lines  show  the 
responses  predicted  by  simulating  the  nonlinear  system  composed  of 
the  control  law  from  «'[,  to  0i,  02  and  the  approximation  (5). 
The  output  is  found  to  decrease  to  small  values  in  about  2  s,  and  the 
predictions  using  the  approximate  nonlinear  system  are  good.  The 
linearized  approximate  system  was  used  for  the  design  with  success. 

In  the  simulations,  the  system  converged  despite  a  10%  initial  error 
in  magnitude  and  frequency.  However,  an  undesirable  behavior  was 
found  to  occur  for  an  initial  frequency  error  of  opposite  sign,  and  it  is 
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Fig.  4.  Improved  implementation  of  Chaplin  and  Smith  s  method. 


discussed  in  the  next  section.  In  any  case,  one  should  expect  a  finite 
region  of  attraction  and,  in  the  theory  of  phase-locked  loops,  one  will 
find  methods  to  expand  the  region.  Note  also  that,  although  integral 
compensation  in  F(s)  is  not  required  in  theory,  we  were  unable  to 
make  the  scheme  work  with  simple  proportional  control  {F(s)  =  I). 


VII.  Improved  Algorithm 

An  undesirable  behavior  was  found  to  originate  from  the  non¬ 
linear  dynamics  associated  with  the  parameter  9 Specifically,  the 
parameter  9\  sometimes  converged  to  zero  in  simulations,  with  the 
parameter  (9o  becoming  constant  and  the  control  input  becoming  zero. 
The  problem  is  not  specific  to  our  implementation,  but  rather  can  be 
traced  back  to  Fig.  I,  which  shows  that  8 \  —  0  is  an  equilibrium  point 
of  the  closed-loop  system.  The  approximate  analysis  also  predicts 
this  property. 

Fortunately,  the  problem  may  be  solved  with  an  improved  scheme, 
shown  in  Fig.  4.  The  signals  iv  \  and  u)2  are  similar  to  the  previous 
signals,  except  that  multiplication  by  9 1  is  eliminated  in  both  loops. 
The  equations  for  the  control  algorithm  are  the  same  as  before,  except 
for 

uq  =  -  sin(a),  ac  =  cos(a), 

Wi=y  yc.  yds)  =  Pe{s)uds). 

As  a  result,  the  nonlinear  approximation  is  now  given  by 

W*)-  2  'Oi(t)  ~  cos(5a(t)) 

W2 (t)  *  Xf  9*  sin(<5a(0) 
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Ftg.  5.  Estimates  9\  and  9n  of  the  original  and  improved  algorithms. 


Fig.  6.  Alternative  algorithm. 


and  the  equilibrium  associated  with  9  \  =  0  is  eliminated. 

The  responses  of  the  improved  algorithm  for  the  same  conditions 
as  in  Fig.  3  are  faster  for  the  same  algorithm  parameters  (convergence 
within  0.6  instead  of  1.2  s).  For  brevity,  the  corresponding  figures 
are  not  shown.  On  the  other  hand,  Fig.  5  is  offered  to  show  how 
the  undesirable  behavior  is  eliminated  with  the  improved  algorithm. 
The  initial  conditions  are  the  same,  except  for  02(0)  =  HO.  The 
dashed  line  is  for  the  original  implementation,  while  the  solid  line  is 
for  the  improved  algorithm.  The  undesirable  behavior  of  the  original 
algorithm  is  visible,  and  is  clearly  avoided  with  the  improved  version. 

One  drawback  of  the  improved  algorithm  is  that  three  copies  of 
the  estimated  plant  Pe{s)  must  be  implemented.  However,  the  third 
copy  may  be  avoided  by  replacing  yc  by  ydt)  =  9i{t)  •  ydt). 


While  this  definition  of  ye  is  not  identical  to  the  previous  one,  it 
is  equivalent  under  the  assumption  of  slow  variation  of  0i,  and  it 
yields  the  same  approximate  system.  Expanding  on  that  idea,  one 
may  further  eliminate  the  other  two  copies  of  P*(s)-  Specifically, 
one  may  obtain  yc  and  yq  using  the  steady-state  approximations,  so 
that 


Again,  these  expressions  are  not  identical  to  the  previous  expressions, 
but  are  equivalent  as  far  as  the  approximate  system  is  concerned. 


2225 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL,  VOL.  44,  NO.  11,  NOVEMBER  1999 


0  0.2  0.4  0.6  0.8  1  1.2 

Time(s) 


Fig.  7.  Responses  of  the  alternative  algorithm. 

VIII.  Comparison  with  an  Alternative  Algorithm 
The  method  of  Chaplin  and  Smith  presents  some  interesting 
similarities  to  a  scheme  proposed  in  [5].  For  reference.  Fig.  6 
shows  a  schematic  of  the  “direct”  algorithm  presented  in  [5].  The 
notation  has  been  made  similar  to  the  notation  of  this  paper  for  easy 
comparison.  Further,  similar  choices  were  made  for  the  design,  so 
that  the  parameters  could  be  set  in  an  identical  manner,  except  for 
the  parameters  <i  l  and  ao,  which  are  equal  to  two  and  to  an  estimate 
of  2/91  Simulations  for  the  alternative  scheme  are  shown  in  Fig.  7. 
The  responses  are  similar  to  those  of  the  improved  algorithm.  In  fact, 
the  approximate  system  responses  are  identical.  Of  course,  it  should 
be  noted  that  such  a  similarity  was  only  obtained  after  considerable 
adjustments  and  redesigns  made  to  the  algorithm  shown  in  Fig.  I,  in 
view  of  the  results  obtained  in  [5]. 


Even  so,  there  remains  an  interesting  distinction  between  the 
two  algorithms.  Specifically,  one  finds  in  Fig.  3  that  the  frequency 
estimate  oscillates  around  its  nominal  value  in  the  steady  state.  As  a 
result,  a  residual  error  is  observed  in  the  output  y,  Neither  of  these 
characteristics  is  found  in  the  responses  of  the  alternate  scheme  in 
Fig.  7. 

The  oscillation  in  the  frequency  estimate  may  be  traced  to  the 
original  diagram  shown  in  Fig.  1,  and  is  due  to  the  signal  at  twice 
the  frequency  of  the  disturbance  coming  from  the  phase  comparator. 
The  oscillation  could  be  reduced  by  lowering  the  bandwidth  of  the 
low-pass  filter  after  the  multiplier.  However,  it  cannot  be  completely 
eliminated.  For  phase-locked  loops  used  in  communications  systems, 
the  bandwidth  of  the  phase-locked  loop  may  be  three  orders  of 
magnitude  smaller  than  the  frequency  of  the  parasitic  signal.  In 
control  problems,  the  frequency  separation  is  typically  much  smaller, 
especially  if  an  objective  is  to  have  convergence  of  the  system  within 
a  few  cycles  of  the  disturbance.  While  a  filter  could  reduce  the 
oscillation,  it  would  also  introduce  a  delay  which  would  force  a 
slower  response  of  the  control  loop.  In  turn,  the  ability  of  the  system 
to  rapidly  reject  the  disturbance  and  to  track  its  variations  would  be 
reduced. 


IX.  Conclusions 

In  this  paper,  we  discussed  a  feedback  algorithm  for  the  rejection 
of  sinusoidal  disturbances  of  unknown  frequency.  The  algorithm  was 
derived  from  a  patent  by  Chaplin  and  Smith,  specifying  components 
that  were  not  identified  originally.  Improvements  were  also  proposed, 
which  included  a  compensating  filter  with  integral  action  and  an 
implementation  which  eliminated  an  undesirable  equilibrium  state  of 
the  control  system.  An  approximate  analysis  provided  considerable 
help  toward  the  selection  of  the  parameters,  and  yielded  stability  as 
well  as  predictable  performance.  Overall,  the  results  demonstrated 
that  a  working  algorithm  could  be  derived  from  the  concepts  of  the 
patent,  and  described  how  it  could  be  done.  The  scheme  was  also 
compared  to  another  algorithm  serving  identical  purposes,  and  while 
the  structure  and  properties  of  the  schemes  were  found  to  be  similar, 
a  significant  difference  was  found  in  the  steady-state  characteristics 
of  the  algorithms.  Although  the  patent  concerns  the  specific  problem 
of  repetitive  vibrations,  the  algorithms  of  the  paper  are  applicable 
to  a  broad  range  of  control  problems  where  periodic  disturbances  of 
unknown  frequency  must  be  rejected. 
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Abstract 

The  paper  proposes  a  discrete-time  algorithm  for  the  rejection  of  sinusoidal  disturbances  of  un¬ 
known  frequency.  The  algorithm  is  adapted  from  an  existing  continuous-time  algorithm  and  the 
overall  nonlinear  system  is  analyzed  using  a  linear  approximation.  The  paper  shows  that  the  noise 
rejection  properties  may  be  predicted  using  an  in-phase/quadrature  decomposition  of  the  noise  similar 
to  the  one  encountered  in  the  theory  of  phase-locked  loops.  Estimates  are  obtained  for  the  standard 
deviations  of  the  plant  output  and  of  the  adaptive  parameters  and  simulations  validate  the  predic¬ 
tions  of  the  analysis ,  despite  the  nonlinear  nature  of  the  adaptive  system  and  the  high  level  of  noise 
applied. 

1  Introduction 

The  rejection  of  periodic  disturbances  is  a  common  problem  in  control  applications.  If  the  frequency  of 
the  disturbance  is  known,  several  techniques  are  available,  including  internal  model  control,  adaptive 
methods,  and  repetitive  control  techniques.  These  methods  are  closely  connected.  In  particular,  it 
was  shown  in  [l]  that  a  standard  adaptive  feedforward  control  algorithm  was  equivalent  to  an  internal 
model  control  law.  Examples  of  applications  include  helicopters  [2]  and  high-density  magnetic  disk 
drives  [3]. 

When  the  frequency  of  the  disturbance  is  not  known,  the  problem  is  considerably  more  compli¬ 
cated.  Sometimes,  the  disturbance  (or  a  signal  related  to  it)  can  be  measured,  and  the  problem 
can  be  solved  using  an  adaptive  feedforward  control  algorithm.  However,  in  many  applications,  it  is 
inconvenient,  if  not  impossible,  to  place  a  sensor  on  the  source  of  the  disturbance  or  along  its  path 
to  the  plant.  For  such  problems,  an  adaptive  implementation  of  the  internal  model  principle  may  be 
considered  [4], [5],  [6],  Such  algorithms  are  highly  nonlinear  and,  aside  from  Lyapunov-type  stability 
results,  little  is  known  about  their  convergence  properties  or  their  sensitivity  to  measurement  noise. 

‘This  material  is  based  upon  work  supported  by  the  U.S.  Army  Research  Office  under  grant  number  DAAH04-96-1- 
0085.  The  content  of  the  paper  does  rot  necessarily  reflect  the  position  or  the  policy  of  the  federal  government,  and  no 
official  endorsement  should  be  inferred. 
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In  [7],  two  adaptive  algorithms  were  proposed  for  the  cancellation  of  sinusoidal  disturbances  with 
unknown  frequency.  The  first  algorithm  was  called  indirect ,  and  was  obtained  by  combining  a  fre¬ 
quency  estimation  algorithm  together  with  an  adaptive  algorithm  for  the  cancellation  of  disturbances 
of  known  frequency.  A  comparable  approach  was  followed  in  [8],  using  a  different  frequency  estimation 
algorithm  and  a  repetitive  control  method.  The  second  algorithm  of  [7]  was  called  direct,  and  esti¬ 
mated  the  frequency,  phase,  and  magnitude  of  the  disturbance  in  an  integrated  fashion.  The  scheme 
was  obtained  by  combining  a  phase-locked  loop  concept  with  a  sinusoidal  disturbance  cancellation 
scheme.  The  algorithm  was  extended  to  handle  multiple  sinusoidal  components  and  implemented 
successfully  in  an  active  noise  control  testbed  [9] . 

As  other  algorithms  for  the  rejection  of  periodic  disturbances  of  unknown  frequency,  the  direct 
algorithm  of  [7]  is  highly  nonlinear.  However,  it  may  be  approximated  by  a  linear  system  using 
techniques  similar  to  those  used  for  phase-locked  loops  [10].  As  a  result,  estimates  of  convergence 
rates  can  be  obtained  that  are  useful  for  design.  The  contribution  of  this  paper  is  to  show  that  the 
continuous-time  algorithm  of  [7]  may  be  adapted  to  discrete-time,  and  that  its  noise  properties  may  be 
predicted  using  an  in-phase/quadrature  decomposition  of  the  measurement  noise  signal.  Simulations 
show  that  the  results  of  the  analysis  are  accurate,  even  in  the  presence  of  high  noise. 

2  A  Discrete-Time  Algorithm 

2.1  Problem  Statement 

The  plant  is  assumed  to  be  described,  in  the  z-transform  domain,  by 

y{z)  =  P{z)(u{z)  -  d{z)) 

y(z)  =  y(z)+n(z)  (1) 

where  u  is  the  control  input,  d  is  the  disturbance,  nis  the  measurement  noise,  y  is  the  plant  output, 
and  y  is  the  measured  plant  output.  P(z )  is  the  transfer  function  of  the  plant,  which  is  assumed  to 
be  stable.  In  the  time-domain,  the  disturbance  is  assumed  to  be  given  by 

d(k)  =  dicos(ad(fc)),  (2) 

with 

Oid(k)  =  LUik  §1.  (3) 

The  disturbance  is  a  sinusoidal  function  with  magnitude  d\,  frequency  uq,  and  initial  phase  8\.  These 
parameters  are  fixed,  but  unknown.  Alternatively,  (3)  can  be  written  in  a  recursive  form  as 

+  1)  =  cnrf(fc)  +  u>i,  a^(0)  =  81.  (4) 

Although  the  disturbance  does  not  need  to  act  at  the  input  of  the  plant,  it  is  assumed  that  an 
equivalent  input  disturbance  may  be  so  defined.  For  its  cancellation,  the  input  is  then  chosen  to  be 
of  the  form 

u(k)  —  &i(k)  cos(a(fc)),  (5) 

with 

a(fc  +  1)  =  a(k)  +  62(h),  a(0)  =  0.  (6) 
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Figure  1:  Plant  and  Adaptive  System 

The  variables  9i(k)  and  02{k)  are  parameters  with  nominal  values  9\*  =  d\  and  02*  =  uq.  The  phase 
of  the  disturbance  is  estimated  through  the  variable  a(k),  and  it  is  determined  by  the  time  history 
of  02 (k)  rather  than  through  separate  adaptation:  even  though  the  problem  is  stated  in  terms  of 
three  unknown  parameters,  the  solution  is  based  on  the  adaptation  of  only  two  parameters  9\{k)  and 
02 (k).  Specifically,  for  the  exponentially  stable  adaptive  scheme  developed  in  this  paper,  the  phase 
Si  is  determined  through 

sl  =  ^2(&2(k)  -  wi)  (7) 

k= 0 

The  structure  of  the  overall  system  is  shown  in  Fig.  1. 

2.2  Basic  Results 

In  a  first  step,  we  assume  that  the  measurement  noise  n  =  0,  so  that  y  =  y.  The  algorithm  is  based 
on  the  following  fact. 

Fact: 

Assume  that: 

•  9\  and  02  vary  sufficiently  slowly  that  the  response  of  the  plant  to  the  signal  u  can  be  approxi¬ 
mated  by  the  steady-state  output  of  the  plant  for  a  sinusoidal  input  with  frequency  02- 

•  the  instantaneous  frequency  02  is  close  to  uq,  so  that  P(eJ02)  can  be  replaced  by  P{e^x  ). 

•  the  phase  error  a  —  ay  is  small. 

Then:  considering  low-frequency  components  only,  the  two  signals 

yi(fc)  1  _  [  y(fc)cos(a(fc))  1  ,  . 

2/2  (k)  -y(k)  sm(a(k))  ' 


3 


are  approximately  given  by 


where 


Proof:  Let 


yi(k) 

—  H 

0i  (k)  -  di 

_  y2(k)  _ 

—  Kjr 

di(a(k)  -  ad(k )) 

1  Re[P(ejui)\  - Im[P(e **)] 

2  Im[P(ejul1)}  Re[P(e^)\ 


PR  =  Re[P{e?»')]t  P1  =  Im[P(e^)\. 


Under  the  assumptions,  the  output  of  the  plant  is  given  by 


(9) 


(10) 


y{k )  =  PRdi(k)  cos(a(k))  -  Pj0i(k)  sin(a(k)) 

-  PRdicos(ad(k))  +  P/di  sin(ad(A;)).  (11) 

Keeping  only  the  low-frequency  components  of  the  signals  y\  and  1/2,  we  have 

Vl(k)  =  1 PR&i(k )  -  ]-PRdi  cos(a(k)  -  ad(k)) 

-  \P1d1  sin (a(k)  -  ad(k)), 

yi(k)  =  +  \pRd\  sin (a(k)  -  ad(k )) 

-  ^-P/di  cos(a(fc)  -  ad(k)).  (12) 

Assuming  that  the  phase  error  a  —  is  small,  the  result  is  obtained. 

Comments:  Equation  (9)  can  be  viewed  as  an  alternative  description  of  the  plant.  Note  that 

a(k)  -  ad(k)  =  a(k  -  1)  -  ad(k  -  1)  +  92(k  -  1)  -  (13) 

so  that,  with  the  change  of  variables,  the  plant  is  approximately  a  linear  time-invariant  plant  with 
two  inputs  9i(k)  and  92{k)  and  two  outputs  yi(k)  and  y2(k).  The  transfer  function  matrix  consists 
of  a  gain  matrix  G  and  a  discrete-time  integrator  in  the  second  channel.  The  parameters  d\  and 
act  as  constant  disturbances  applied  to  the  inputs.  The  parameter  d\  also  appears  as  a  gain  in  the 
second  channel.  In  contrast  to  (9),  equation  (12)  constitutes  a  nonlinear  approximation  of  the  plant. 
This  nonlinear  approximation  is  useful  to  understand  the  transient  properties  of  the  algorithm,  but 
is  not  used  in  this  paper. 

The  elimination  of  the  high-frequency  components  in  the  signals  yi(k)  and  y^ (k)  can  be  achieved 
by  low-pass  filtering.  In  the  algorithm  discussed  in  this  paper,  the  signals  are  applied  to  a  compensator 
which  is  itself  low-pass.  Thus,  no  filter  was  used  for  the  simulations.  However,  it  may  be  added  if 
needed. 


2.3  Compensator  Design 

Define  two  variables  uq,  w2  through 


so  that  the  dynamics  of  the  system  become  decoupled.  Specifically,  in  the  z-domain 


w\  =  6\  —  6\* 

W2  =  ~~~7  [92~92\.  (15) 

Z  J. 

The  control  law  is  chosen  to  be  the  cascade  of  the  transformation  (14)  and  compensators 

9l  =  h  =  (16) 

The  poles  at  z  =  1  are  included  in  the  compensators  to  guarantee  the  rejection  of  the  constant  distur¬ 
bances  composed  of  d\  and  (the  compensators  axe  selected  as  conventional  controllers  with  integral 
compensation).  The  compensator  transfer  functions  C\(z )  and  C2{z)  are  designed  to  guarantee  the 
stability  of  the  closed-loop  systems  and  satisfactory  transient  responses.  For  example,  one  can  choose 


Ci{z )  =  -51,  C2{z )  =  -g2- — — 

Z  —  Zb 


(17) 


where  gi,  g2,  za,  and  are  design  parameters.  The  overall  adaptive  algorithm  is  then  given  by  (5), 
(6),  (8),  (14),  (16),  and  (17). 

Two  simple  tuning  methods  are  proposed  for  the  parameters  of  the  control  law.  The  first  is  the 
equivalent  of  the  continuous-time  control  law  of  [7].  Let  za  be  some  desirable  location  to  place  the 
closed-loop  poles.  For  the  first  channel,  the  objective  leads  to  a  parameter  gi  =  l-Zd-  For  the  second 
channel,  the  parameters  are 


3(1  -zd? 
3i  =  — - ' 


za 


z_d_±  2 

3  ’ 


Zb  =  3 zd  -  2. 


(18) 


The  second  method  is  an  alternative  proposed  specifically  for  the  discrete-time  version  of  the  algo¬ 
rithm.  It  consists  in  placing  the  pole  of  the  compensator  for  the  second  channel  at  the  origin  and 
neglecting  the  effect  of  the  pole.  The  remaining  closed- loop  poles  are  both  placed  at  z^,  giving  the 
following  parameters 

92  = 

The  response  of  the  algorithm  with  the  second  tuning  method  was  found  to  be  faster  and  with  a 
wider  convergence  range,  but  also  with  a  higher  sensitivity  to  noise. 

Estimates  of  the  magnitude  of  the  disturbance  and  of  its  frequency  are  required.  These  estimates 
are  used  as  initial  conditions  for  the  variables  9\  and  #2,  and  also  for  the  design  of  the  compensators. 
The  estimate  of  the  magnitude  of  the  disturbance  d\  is  used  to  adjust  the  gain  £2  of  the  compensator 
C<i{z)  and  the  estimate  of  the  frequency  of  the  disturbance  is  used  to  adjust  the  gain  matrix  G"1.  The 
variables  gz  and  G-1  may  be  kept  constant  during  operation,  or  they  may  be  updated  as  functions 
of  the  variables  6\  and  $2-  In  experiments  with  this  algorithm  [9],  the  frequency  response  of  the  plant 
was  estimated  automatically  in  an  initial  tuning  phase,  and  the  matrix  G  was  updated  by  linear 
interpolation  of  a  table  look-up  as  a  function  of  the  estimated  frequency.  In  the  simulations  of  this 
paper,  fixed  values  were  used.  Generally,  the  frequency  of  the  disturbance  may  be  estimated  using 
an  estimation  algorithm  (such  as  the  one  discussed  in  [7],  or  those  of  [12]).  The  magnitude  may 
be  estimated  using  the  measured  RMS  output,  or  a  fast  Fourier  transform.  However,  the  region  of 
convergence  of  the  adaptive  scheme  is  generally  large  enough  that  estimates  based  on  prior  information 
are  typically  sufficient. 


2(1  —  Zd) 


za  = 


Zd  +  1 


Zb  =  0. 


(19) 
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3  Noise  Analysis 

3.1  Linear  Approximation 

The  previous  derivation  considered  the  noiseless  case,  which  resulted  in  nominal  values  for  the  pa¬ 
rameters  9\  =  d\,  &2  =  wi,  and  nominal  functions  a*(k)  —  ad(k),  u*(k)  =  d\  cos (ad(k)),  y*(k)  =  0. 
Now,  the  effect  of  a  measurement  noise  n(k)  added  to  the  output  y(k)  is  evaluated.  The  idea  of  the 
derivation  is  to  assume  that  the  noise  is  sufficiently  small  that  second-order  effects  can  be  neglected 
and  to  decompose  the  noise  into  in-phase  and  quadrature  components. 

Define  9\  —  4-  89\,  62  =  9%  +  892,  a  =  a*  4-  8a,  u  —  u*  +  8u,  y  =  y*  +  8y,  y  =  y*  +  8y  +  n,  where 

y  is  the  actual  output  of  the  plant,  and  y  is  the  measured  output  (the  one  used  by  the  algorithm). 
Since  y*  =  0,  y  —  8y  and  y  =  8y,  where  8y  =  8y  +  n.  Define  components  of  the  measured  output 

yi(*0 
_  m(k) 

Again,  these  two  variables  are  the  ones  that  are  used  by  the  algorithm,  instead  of  yi,  y 2,  which  are 
not  available  but  remain  as  defined  previously  for  the  purpose  of  analysis.  For  the  noise,  we  introduce 
the  in-phase  and  quadrature  components 

ni(k)  __ 
ri2  (k) 

From  (20), 

Vi(k)  =  (y(k)  + 
m(k)  =  ~(y{k )  ■ 

Assuming  that  the  noise  is  small  and  neglecting  second-order  effects,  it  follows  that 


n(k)  cos (ad(k)) 
-n(k)  sin(ad(k)) 


(21) 


n(k))  cos (ad(k)  +  8a(k)), 
f-  n(k))  sin (ad(k)  +  8a(k)). 


(22) 


y(k)  cos  (a(k)) 

-y(k)  sin(a(fc)) 

(20) 


Vi(k) 

=  y(k)  cos(ad(k))  +  rai(fc), 

m(k) 

=  -y(k)  sin (ad(k))  +  n2(A;). 

(23) 

The  control  input  is  given  by 

u(k)  — 

(di  +  89x(k))  cos  (ad(k)  +  8a(k)), 

(24) 

so  that,  approximately, 

8u(k)  =  cos(ad(k))89i(k)  -  dism(ad(k))8a(k). 

(25) 

Assuming  slow  variations  of  89i  and  8a,  the  output  of  the  plant  corresponding  to  this  input  is  given 

by 


y(k)  =  Pjtcos(ad(k))891(k)  -  Fjidisin(ad(k))8a(k) 

—Pi  sm(ad(k))89i(k)  —  Pid\  cos(ad(k))8a(k).  (26) 
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Multiplication  of  this  signal  by  cos(a<i)  and  sin(ad),  and  application  to  (23),  yields  signals  whose 
first-order/low-frequency  components  are  given  by 


Vl(*) 

—  n 

S6i(k) 

1 

ni(k) 

_  mik)  _ 

d\8a{k ) 

“T 

n2(k) 

(27) 


The  result  shows  that,  to  first-order,  the  effect  of  the  measurement  noise  is  equivalent  to  the  addition 
of  two  noise  variables  in  the  transformed  system.  Again,  analysis  can  again  be  performed  in  a  linear 
time-invariant  framework. 


3.2  Computation  of  Variances 

A  transfer  function  matrix  relates  the  noise  sources  to  the  parameter  deviations,  with 


r 

Ci(z) 

0 

(z-l)Ci(z) 

86\ 

692 

8a 

z-l-Ci(z) 

0 

0 

G'1 

n\ 

(*-i  r-diCtiz) 
Cl(z) 

n  2 

(28) 


To  apply  the  results  and  estimate  the  performance  of  the  algorithm  in  the  presence  of  noise,  the 
power  spectra  of  the  noise  components  n\  and  n 2  must  be  known.  If  n  is  a  white  noise  with  variance 
<72,  it  is  common  to  assume,  in  the  analysis  of  phase-locked  loops,  that  n\  and  n 2  are  uncorrelated 
white  noises  with  variances  equal  to  \<j2  [10].  We  will  make  the  same  assumption.  The  power  spectra 
of  6&it  S&2 ,  and  5a  can  then  be  deduced  using  the  transfer  function  (28),  and  the  variances  of  these 
variables  can  be  computed  by  integration  of  the  power  spectra. 

Alternatively,  a  Lyapunov  equation  may  be  solved,  using  the  following  state-space  description 


where 


x(k  +  1)  =  Ax(k)  +  BG~lv(k), 


A 


x(k) 


-  9\ 

0 

0 

0 

~9i 

0 

0 

1  + 

1 

~92di 

,  B  — 

0 

-92 

0 

~Zb 

0 

92zad\ 

0 

92 z  a 

0 

1 

0 

1 

0 

0 

eei{k) 
s e2{k) 
893(k) 
6a(k) 


v(k)  = 


m(fc) 

n2(k) 


(29) 


(30) 


Note  that  these  equations,  as  well  as  previous  equations,  assume  that  the  G  matrix  used  by  the 
compensator  is  the  true  matrix  corresponding  ot  the  plant.  However,  the  analysis  can  be  extended 
to  account  for  a  difference  in  the  true  and  estimated  matrices.  Defining  V  =  E{ vvT)  =  |u2/,  and 
assuming  that  n\  and  n2  are  white  noise  sources,  the  value  of  the  steady-state  covariance  matrix 
P  —  E(xxt)  is  given  by  the  solution  of  the  discrete  Lyapunov  equation  ([11],  p.  471) 


AXAt  +  BG~1V(G~1)tBt  =  X. 


(31) 
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which,  is  easily  obtained  using  modern  mathematical  software. 

Regarding  the  output  signals  y  and  y,  (26)  shows  that  y  is  a  sinusoidal  function  with  the  same 
frequency  as  the  disturbance,  but  with  a  peak  and  phase  that  are  random  processes.  The  variance  of 
the  magnitude  of  the  sinusoid  is  equal  to  {Pr2 + Pi2)(E(69i2)  +di2E(6a2)).  Although  the  variance  of 
the  plant  output  is  a  function  of  time,  its  average  over  the  period  of  the  disturbance  may  be  defined. 
This  average  variance  may  be  estimated  experimentally  or  in  simulations,  and  is  a  significant  perfor¬ 
mance  measure  for  the  algorithm.  Using  the  previous  results,  one  finds  that  the  average  variances  of 
the  true  and  measured  plant  outputs  are  given  by 

Eavg(y2)  =  y-2)  {E{86 12)  +  d\2E(8a2)) 

Eavg{y  )  =  Eavg(y  )  +  cr  .  (32) 

The  subscript  avg  refers  to  the  averaging  of  the  variances  over  the  period  of  ct'd(fc). 

4  Simulation  Results 

We  present  simulation  results  obtained  for  a  plant  which  is  a  pure  delay  P(z)  =  z~lQ.  The  disturbance 
has  magnitude  d\  =  1,  a  period  equal  to  100  time  samples,.  The  initial  phase  was  set  at  Si  =  0, 
but  could  be  set  at  arbitrary  values.  The  estimates  used  by  the  algorithm  are  0.8  for  the  magnitude 
and  120  steps  for  the  period.  The  desired  closed-loop  pole  was  selected  to  be  z^  =  0.99,  leading  to 
gi  =  0.01,  g<i  =  0.025,  za  =  0.995,  and  z^  =  0  (for  the  second  tuning  method).  These  parameters  were 
left  fixed  throughout  the  simulations. 

Fig.  2  shows  the  measured  output  of  the  plant  (y).  The  plot  on  the  left  corresponds  to  a 
simulation  for  a  low  noise  condition:  cr  =  0.01,  with  the  uncompensated  plant  output  being  a  sinusoid 
with  magnitude  equal  to  1.  The  plot  on  the  right  corresponds  to  a  high  noise  condition,  with  cr  =  0.5 
(or  a  standard  deviation  equal  to  50%  of  the  magnitude  of  the  imcompensated  plant  output,  instead  of 
1%).  Figs.  3  and  4  show  the  responses  of  the  magnitude  and  frequency  estimates  {9\  and  O2),  showing 
convergence  towards  the  expected  values  (the  nominal  magnitude  is  1  and  the  nominal  frequency  is 
2?r/100  =  0.0628).  In  the  high  noise  plots,  the  convergence  of  the  parameters  towards  their  nominal 
values  is  barely  visible  in  the  fluctuations  induced  by  the  noise.  However,  the  output  is  significantly 
smaller  than  what  it  would  be  under  uncompensated  conditions,  as  shown  in  Fig.  5. 

The  predicted  variances  were  computed  by  solving  the  discrete  Lyapunov  equation.  The  results 
were  compared  to  sample  variances  obtained  from  the  simulations  by  averaging  deviations  between 
k  =  1000  and  k  =  11000  (in  other  words,  a  longer  time  period  was  used  than  for  the  plots,  and 
the  initial  transient  was  left  out  of  the  computations).  The  results  are  summarized  in  Table  1.  The 
standard  deviations  predicted  by  the  solution  of  the  Lyapunov  equation  are  given  under  the  heading 
of  “analysis”,  while  the  results  obtained  through  averaging  of  the  simulations  results  are  shown  as 
’’simulation.”  The  numbers  show  a  good  match  between  the  predictions  of  the  analysis  and  the  values 
observed  in  simulations.  One  also  finds  that  the  variation  of  the  measured  output  is  primarily  made 
of  the  noise  itself,  rather  than  a  variation  induced  by  the  fluctuations  of  the  adaptive  parameters. 

Although  the  analysis  of  the  paper  and  the  simulations  emphasized  the  steady-state  performance 
of  the  algorithm,  significant  changes  in  the  disturbance  parameters,  as  well  as  abrupt  changes,  may 
be  accommodated  by  the  algorithm.  Fig.  6  shows  the  results  of  a  simulation  with  low  noise  over  3000 
samples,  with  the  magnitude  and  the  frequency  of  the  disturbance  increased  by  50%  at  k  =  1000 
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Magnitude  Estimate  Plant  Output 


Figure  2:  Measured  Plant  Output  -  Low  Noise  (Left),  High  Noise  (Right) 
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Figure  3:  Magnitude  Estimate  -  Low  Noise  (Left),  High  Noise  (Right) 
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Figure  4:  Frequency  Estimate  -  Low  Noise  (Left),  High  Noise  (Right) 
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Figure  5:  Measured  Plant  Output  without  Compensation  and  with  High  Noise 
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y 

y 

<501 

<502 

a  -  0.01 
Analysis 
Simulation 

0.0014 

0.0016 

0.0101 

0.0103 

0.0010 

0.0011 

3.5610-4 

3.6510-4 

a  =  0.5 

Analysis 

Simulation 

0.0718 

0.0881 

0.5051 

0.5110 

0.0501 

0.0613 

0.0178 

0.0180 

Table  1:  Standard  Deviations  of  Plant  Output  and  Parameters  -  Analysis  vs.  Simulation 


and  k  —  2000,  respectively.  At  k  =  1000,  the  phase  also  jumps  by  180°  (the  maximum  possible). 
The  figure  shows  the  response  of  the  magnitude  estimate  (left)  and  of  the  frequency  estimate  (right). 
After  some  transient  responses,  both  estimates  converge  to  their  desired  values. 


Figure  6:  Adaptive  Parameter  Responses  to  Sudden  Changes  in  the  Disturbance  Parameters 


5  Conclusions 

In  this  paper,  we  discussed  a  method  for  the  rejection  of  sinusoidal  disturbances  with  unknown 
frequency.  The  discrete-time  algorithm  was  obtained  from  an  existing  continuous-time  algorithm, 
with  some  non-trivial  adjustments.  Further  extensions  to  handle  multiple  harmonics  are  possible. 
The  design  of  the  control  law  could  be  conveniently  carried  out  using  linear  techniques.  In  addition, 
a  separate  analysis  predicted  the  loss  of  performance  incurred  in  the  presence  of  measurement  noise, 
and  the  amount  of  fluctuation  induced  in  the  adaptive  parameters.  Through  simulations,  it  was  found 
that  the  algorithm  was  not  only  effective  at  rejecting  sinusoidal  disturbances  in  the  presence  of  high 
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noise,  but  also  that  its  performance  could  be  accurately  predicted.  The  derivations  relied  on  a  phase- 
locked  loop  technique  that  decomposes  the  noise  signal  into  in-phase  and  quadrature  components. 
Such  an  approach  has  not  been  widely  used  in  control,  but  was  found  helpful  for  this  problem.  The 
results  that  were  obtained  do  not  have  counterparts  for  other  algorithms  proposed  in  the  literature 
for  the  rejection  of  periodic  disturbances  of  unknown  frequency. 
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Abstract:  The  paper  presents  a  multi-channel  active 
noise  control  algorithm  that  is  designed  to  reject  peri¬ 
odic  noise  signals  of  unknown  frequency.  The  algorithm 
is  the  extension  of  a  previously- proposed  disturbance  re¬ 
jection  algorithm  in  which  the  frequency  of  the  distur¬ 
bance  is  estimated  through  an  adaptive  notch  filter  and 
the  estimate  is  used  in  a  feedforward  disturbance  rejec¬ 
tion  scheme.  Improvements  over  the  earlier  approach 
include  a  better  frequency  estimation  scheme  and  an 
extension  to  multi-channel  systems.  Experimental  re¬ 
sults  on  an  active  noise  control  testbed  demonstrate  the 
validity  of  the  analytical  results  and  the  success  of  the 
method  in  a  practical  environment. 

1,  Introduction 

The  system  for  multi-channel  active  noise  control  (ANC) 
is  shown  in  Fig.  I.  Microphones  sense  the  effect  of  the 
noise  source  and  monitor  how  well  the  control  system  is 
performing.  The  microphone  signals  are  then  processed 
by  a  digital  signal  processing  system,  and  an  anti-noise 
field  is  generated  through  speakers.  The  dynamics  of 
the  sound  propagation  from  the  speakers  to  the  micro¬ 
phones  constitutes  the  plant.  The  objective  of  the  ANC 
system  is  to  eliminate  or  significantly  reduce  the  noise 
level  at  the  microphone  locations  through  destructive 
interference^]. 

Multi-channel  (or  multiple- input/multiple-output)  con¬ 
trol  is  needed  for  the  rejection  of  the  noise  at  multiple  lo¬ 
cations  in  a  3-dimensional  space.  Compared  with  single- 
chaunel  ANC  system,  the  complexity  of  multi-channel 
ANC’s  is  significantly  higher.  Also,  noise  generated  by 
engines,  compressors,  fans,  and  propellers  is  periodic. 
The  frequency  of  the  noise  is  not  fixed  a  priori  and  is 
often  time-varying.  Therefore,  the  algorithm  discussed 
in  this  paper  is  tailored  to  periodic  disturbances  of  un¬ 
known  frequency.  The  problem  was  considered  in  [2], 
where  a  direct  approach  and  an  indirect  approach  were 
proposed.  The  direct  approach  was  successfully  tested 
in  a  single-channel  system,  with  the  results  reported  in 
[3].  The  indirect  approach  was  found  to  suffer  from  poor 
convergence  properties,  but  a  fix  was  later  found  and 
simulations  for  a  single-channel  system  showed  promis- 
ingresults  [4].  This  paper  extends  the  indirect  adaptive 
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the  policy  of  the  federal  government,  and  no  official  endorsement 
should  he  inferred. 
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algorithm  of  [2]  and  [4]  to  a  multi-channel  system  and 
reports  experimental  results.  The  results  show  that,  de¬ 
spite  high  initial  uncertainty,  the  multi-channel  control 
algorithm  is  able  to  reduce  significantly  the  noise  level 
at  the  microphone  locations.  In  addition,  the  algorithm 
converges  rapidly. 


Noise 


Figure  1:  Active  Noise  Control  System 

2.  Multi-Channel  Adaptive  Algorithm 

Problem  Statement 

Assume  that  the  effect  of  the  noise  is  additive  and  that 
the  channels  from  the  speakers  to  the  microphones  can 
be  described  by  stable,  linear  time- invariant  systems 
with  transfer  functions  PlJ(s)<  where  i  =  1,2  stands 
for  microphones  #1,2  and  j  =  1.2  stands  for  speak¬ 
ers  #1,2.  For  simplicity,  a  2  x  2  system  is  considered. 
However,  the  techniques  may  be  extended  to  systems  of 
higher  dimensions.  Fig.  2  shows  the  structure  of  the 
two-input  two-output  system,  where  Ui(s)>  yi(s ).  and 
di(s),  are  the  Laplace  transforms  of  the  speaker  signals, 
the  microphone  signals,  and  the  disturbance  signals,  re¬ 
spectively.  Define  the  vector  of  plant  outputs  F(s),  so 
that 


’  yi(s)  ' 

=  f  Pu(a)  Pi2(s)  ‘ 

■  Ui(s)  -  di{s)  ' 

.  3/2  (s)  _ 

|  _  P2l(s)  P22(s) 

_  u2(s)  -  d2(s )  _ 

The  objective  of  the  control  system  is  to  generate  U\(t) 
and  U2(J)  such  that  Y(t)  — *  0,  as  t  —>  oo,  i.c.,  such 
that  the  effects  of  the  disturbance  signals  at  the  two 
microphone  locations  are  eliminated. 

The  disturbance  signals  di^s)  are  assumed  to  be  sinu¬ 
soidal  signals  with  unknown  frequency.  The  frequency 
is  assumed  to  be  the  same  for  both  signals,  although  the 
amplitudes  and  phases  are  assumed  to  be  independent. 
The  disturbance  signals  are  represented  by 

d\{t)  =  cos(u ;*t)  -  Q*x  sin (u*t)  . 
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d2(t)  =  9*2  cos(u;*£)  -  9*2  sin(u;*£)  , 

where  ut*  is  the  unknown  frequency  of  the  disturbance. 
In  addition  to  the  frequency,  the  unknown  characteris¬ 
tics  of  the  disturbance  signals  are  parameterized  as  the 
amplitudes  of  the  cosand  sin  components.  This  para¬ 
meterization  enables  the  use  of  a  standard  adaptive  can¬ 
cellation  algorithm  for  the  disturbance  rejection.  Note 
that  although  a  single  sinusoidal  component  of  the  dis¬ 
turbance  is  assumed,  additional  harmonic  components 
may  easily  be  added  to  the  formulation  of  the  problem 
as  well  as  to  the  algorithm. 


Figure  2:  Multi-Channel  Noise  Control  Problem 
Frequency  Estimation 

The  indirect  approach  to  active  noise  control  [2]  consists 
of  estimating  the  frequency  of  the  sinusoidal  disturbance 
and  using  the  estimate  in  an  adaptive  disturbance  rejec¬ 
tion  scheme  for  known  frequency.  In  simulations,  it  was 
found  that  the  adaptive  notch  filter  developed  by  Regalia 
[5]  performed  well.  In  [2],  a  continuous-time  version  of 
Regalia’s  algorithm  was  studied  using  averaging  analy¬ 
sis,  and  good  results  were  obtained  for  the  estimation 
of  the  frequency  of  a  signal.  However,  poor  convergence 
properties  were  observed  when  combining  the  estimation 
algorithm  with  a  disturbance  rejection  algorithm.  The 
problem  was  traced  to  the  fact  that  the  disturbance  re¬ 
jection  algorithm  eliminated  the  signal  upon  which  fre¬ 
quency  estimation  was  based,  resulting  in  a  slow  conver¬ 
gence  of  the  overall  scheme. 

In  [4],  a  fix  was  found  to  resolve  the  problem.  The  fix 
simply  consisted  of  subtracting  the  effect  of  the  control 
signals  on  the  microphones.  Fig.  3  shows  the  implemen¬ 
tation  of  the  concept  on  the  2-channel  system.  Pu(s) 
and  Pi  2  (5)  are  estimates  of  Pi  1(5)  and  Pi2(s),  respec¬ 
tively.  ANF  refers  to  the  adaptive  notch  filter  and  uj  to 
the  estimate  of  the  frequency.  Only  one  of  the  micro¬ 
phone  signals  is  used  for  the  frequency  estimate  in  this 
implementation.  The  effect  of  the  control  signals  Ui(t) 
and  U2(£)  on  the  output  of  the  plant  is  computed  as  an 
output  signal  y\u  which  is  subtracted  from  the  micro¬ 
phone  signal  before  the  resulting  signal  is  applied  the 


adaptive  notch  filter.  This  modification  results  in  better 
frequency  estimation,  which  is  critical  in  the  practical 
implementation  and  improves  the  stability  of  the  overall 
system.  Surprisingly,  it  was  found  that  the  estimates  of 
the  plant  transfer  function  did  not  have  to  be  precise  in 
order  for  the  approach  to  work  well. 


Figure  3:  Frequency  Estimation  Scheme 
Disturbance  Cancellation 

The  second  component  of  the  indirect  adaptive  algo¬ 
rithm  is  a  standard  adaptive  cancellation  algorithm  ([2], 
[6]),  extended  for  the  multi- input,  multi-output  case. 
The  control  signals  are  given  by 


ui  (t)  =  9cl  (t)  cos(t ut)  -  9S 1  (t)  sin (ut)  , 
u2{t)  =  9c2{t)  cos  (ujt)  -  0S2(t)  sin  (ut)  . 

Define  the  vectors, 


u(t)  = 


Uxit) 
U2  (t) 


y(t)  = 


y  m 

V2  (t) 


9c{t)  = 


Ocl(t) 

9c2it) 


6s{t)  = 


Qs\(t) 

0&(t) 


so  that  the  controller  signal  vector  can  be  written  as 


u(t)  =  9c(t)  cos(otf)  —  9s{t)  sin(u;£)  . 


The  adaptive  parameters  9c(t),  9s(t)  are  updated  accord¬ 
ing  to 


9c 

9s 


- 9  G-1 


y  cos(ujt) 
~ysm(ut) 


where  g  >  0  is  an  arbitrary  adaptation  gain.  An  averag¬ 
ing  analysis  may  be  used  to  show  that,  for  small  enough 
Qs  the  stability  of  the  adaptive  system  is  guaranteed  if 
the  4  x  4  matrix  G  is  chosen  to  be 

Pr  -  Pi  ' 

Pi  Pr  . 

with 


PO'w)  =  PR  +  jP[  = 


Pn{jui) 

Pziiju)  P22CM 
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The  implementation  of  the  algorithm  requires  the  in¬ 
verse  of  the  4x4  matrix,  G ,  which  is  equal  to 


C?-1 


ZT1 

-Pn'PtD-' 


P^PiD- 1  ' 

D-1 


with  D  =  Pr  +  Pi P ft1  Pi,  assuming  that  the  matrix 
is  invertible.  In  real-time  implementation,  the  approxi¬ 
mate  inverse. 


A  (.Mi) 

with  Pr 


Pi 


=  PR+jPl  , 

2  N 

=  —  ^  r(n)cos(w0n)  , 

n=  1 
2  ^ 

=  ~  Jj  X]  Y(n)  sin(won)  , 


G~l  ~  2 


(PS  +  P/)-1/’* 


(P£  +  P2)-\P/  1 

(•Pfl  +  P/)_1P^  j  ’ 


was  used,  which  reduced  the  computational  complexity. 
The  inverse  is  exact  if  PrPi  =  PiPr ,  2.e,  if  the  real  and 
imaginary  parts  of  the  plant  frequency  response  matrix 
are  commutable.  This  property  is  satisfied  in  particular 
if 


Pn(M)  =  ^22  CM)  ) 

A2(M)  =  ^21  (M)  • 

These  conditions  may  be  viewed  as  ‘"symmetry”  condi¬ 
tions,  because  the  behavior  of  the  system  is  the  same 
if  the  inputs  and  outputs  are  permuted.  In  the  exper¬ 
iments,  the  geometric  disposition  of  the  speakers  and 
microphones  was  symmetric,  and  the  conditions  were 
verified  to  be  (approximately)  true. 

3.  Experimental  Results 

The  scheme  was  implemented  on  an  experimental  ac¬ 
tive  noise  control  system  developed  at  the  University  of 
Utah.  The  algorithm  was  coded  in  assembly  language  of 
Motorola  DSP96002  32-bit  floating-point  digital  signal 
processor.  The  sampling  rate  was  set  at  8  kHz.  A  sin¬ 
gle  bookshelf  speaker  with  a  4-inch  low-frequency  driver, 
located  approximately  4  ft  away  from  the  error  micro¬ 
phones,  generated  the  periodic  signal  constituting  the 
noise  source.  The  signals  were  collected  by  two  micro¬ 
phones  separated  by  2.7  ft.  These  signals  were  passed 
through  an  anti-aliasing  filter  and  sampled  by  a  self¬ 
calibrating  16-bit  analog-to-digital  converter  before  be¬ 
ing  sent  to  the  DSP  system.  The  controller  output  sig¬ 
nals  were  sent  to  two  noise  cancelling  speakers  separated 
by  2.7  ft  and  located  3  ft  in  front  of  the  microphones  (or 
1  ft  away  from  the  noise  source). 

The  algorithm  requires  knowledge  of  the  frequency  re¬ 
sponse  matrix  P(juj)  of  the  plant  for  the  frequency  esti¬ 
mation  as  well  as  for  the  disturbance  rejection.  During 
an  initial  identifying  stage,  an  estimate  P(M)  was  ob¬ 
tained,  which  was  fixed  and  used  in  the  control  scheme 
afterwards.  The  frequency  response  at  a  given  frequency 
Lu\}  was  determined  by  the  empirical  transfer  function  es¬ 
timate  (ETFE,  [7]).  Let  the  first  input  be  a  pure  sinusoid 
of  coupon)  and  the  second  input  be  zero,  A  (Mo )i  which 
is  the  first  colomn  of  P(M o)«  was  obtained  through 


where  Y (n)  is  the  vector  of  plant  outputs,  and  N  =  ~ 

with  k  =  1,2,3 .  The  real  and  imaginary  parts  of 

the  frequency  response  were  obtained  at  32  different  fre¬ 
quencies,  spaced  between  90  Hz  and  375  Hz,  and  the 
results  were  saved  in  a  look-up  table.  In  real-time,  the 
frequency  response  at  the  estimated  frequency  was  ob¬ 
tained  by  linearly  interpolating  the  look-up  table  and 
the  matrix  G  was  adjusted  accordingly. 

Figure  4  and  Fig.  5  show  the  signals  from  the  error 
microphones  #1  and  #2,  respectively.  For  the  purpose 
of  comparison,  the  control  algorithm  was  not  engaged 
until  3.0  sec.  into  the  experiment.  The  frequency  of  the 
noise  was  160  Hz.  The  figures  show  that  the  algorithm, 
once  engaged,  reduced  the  effect  of  the  disturbances  by 
approximately  20  dB  (a  factor  of  10)  within  one  second. 


Figure  4:  Error  Signal  From  Microphone  #1 

The  frequency  estimate  and  two  of  the  amplitude  esti¬ 
mates  are  shown  in  Fig.  6  and  Fig.  7,  respectively.  The 
initial  values  of  the  magnitude  estimates  were  zero,  and 
the  initial  frequency  estimate  was  100  Hz.  The  figures 
demonstrate  the  wide  convergence  region  of  the  adaptive 
algorithm. 

Figure  8-11  show  the  estimates  of  the  plant  frequency  re¬ 
sponses  that  were  used  by  the  adaptive  algorithm.  Fig.8 
and  Fig. 9  are  the  magnitude  response  and  the  phase  re¬ 
sponse  of  Pn(juj),  respectively,  while  Fig.  10  and  Fig.  11 
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Figure  5:  Error  Signal  From  Microphone  #2 
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Figure  6:  Frequency  Estimate(Hz) 

are  the  respective  responses  of  Pi2(j^)-  The  other  el¬ 
ements  of  the  plant  transfer  function  matrix  were  as¬ 
sumed  identical  by  symmetry  and  were  not  identified. 
This  assumption  need  not  be  made  in  general,  but  if 
the  assumption  is  satisfied,  it  may  be  used  to  reduce  the 
complexity  of  the  code.  The  magnitude  responses  show 
a  significant  number  of  peaks  and  valleys,  which  are  not 
due  to  noise  or  inaccuracies  in  the  system.  Rather,  they 
are  repeatable  and  may  be  attributed  to  acoustic  reso¬ 
nances  in  the  small  room  that  was  used  for  experimen¬ 
tation.  The  phase  responses  mostly  consist  of  the  linear 
phase  associated  with  the  delay  due  to  sound  propaga¬ 
tion  from  the  speakers  to  the  microphones.  These  fre¬ 


A 


Time  (sec) 


Figure  7:  Amplitude  Parameter  Estimates 

quency  response  plots  are  indicative  of  the  significant 
control  challenge  posed  by  active  noise  cancellation  in 
3D  space. 


Frequency  (Hz) 


Figure  8:  Magnitude  Response  of  Pn(s) 

4.  Conclusions 

An  active  noise  control  algorithm  was  proposed  for 
multi-channel  systems.  The  case  of  sinusoidal  distur¬ 
bances  of  unknown  frequency  was  considered.  General 
periodic  disturbances  may  be  rejected  with  this  algo¬ 
rithm,  but  such  rejection  requires  more  complex  com¬ 
puter  codes,  which  has  not  been  developed  or  tested 
at  this  time.  The  approach  consists  of  estimating  the 
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Figure  9:  Unwrapped  Phase  Response  of  Pu{s)  (rad.)  Figure  11:  Unwrapped  Phase  Response  of  Pi2{s)  (rad.) 


Frequency  (Hz) 


Figure  10:  Magnitude  Response  of  Pn(s) 


frequency  of  the  disturbance  and  using  the  estimate  in 
a  disturbance  rejection  scheme  designed  for  the  known 
frequency  case.  An  important  element  is  the  use  of  a 
modified  plant  output  for  frequency  estimation,  so  that 
the  resultant  signal  does  not  vanish  when  noise  reduc¬ 
tion  becomes  effective.  Experimental  results  showed  the 
validity  of  the  scheme  proposed  and  the  success  of  the 
algorithm  in  a  dual  channel  active  noise  control  system. 
The  methods  are  not  limited  to  active  noise  control  prob¬ 
lems,  but  may  be  applied  to  a  wide  range  of  control 
problems,  where  disturbances  of  unknown  or  varying  fre¬ 
quency  must  be  rejected. 
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